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ABSTRACT 

This  report  presents  details  of  a  formal  technique  called  conceptual  reasoning. 
Conceptual  reasoning  is  a  knowledge  representation  and  reasoning  framework  for 
multiple-agent  belief  revision.  Because  conceptual  reasoning  has  a  particular  interest  in 
dealing  with  contradictory  and  partial  information,  it  lends  itself  to  applications  in 
Defence  Intelligence.  We  demonstrate  the  practical  application  of  conceptual  reasoning 
in  a  particular  Defence  Intelligence  domain:  multi-sensor  fusion. 
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Executive  Summary 

This  report  presents  details  of  a  formal  technique  called  conceptual  reasoning.  Concep¬ 
tual  reasoning  is  a  knowledge  representation  and  reasoning  framework  for  multiple-agent 
belief  revision.  Because  conceptual  reasoning  has  a  particular  interest  in  dealing  with  con¬ 
tradictory  and  partial  information,  it  lends  itself  to  applications  in  defence  intelligence. 
We  demonstrate  the  practical  application  of  conceptual  reasoning  in  a  particular  defence 
intelligence  domain:  multi-sensor  fusion.  Other  applications  foreseen  for  Defence  include 
the  analysis  of:  resource  inventory,  command  and  control  structures,  and  command  and 
control  vocabulary. 

We  present  the  theory  of  formal  concept  analysis  (FC A) .  A  context  in  FC A  is  defined 
as  consisting  of  a  set  of  objects  G ,  a  set  of  attributes  M,  and  an  incidence  function  I 
which  assigns  attributes  to  objects  by  mapping  G  x  M  to  the  values  {0,2}.  In  FCA  a 
related  notion  is  that  of  a  concept ;  given  a  context  K  its  set  of  concepts  C(K)  forms 
a  complete  lattice ,  called  a  concept  lattice  of  K.  We  also  consider  partial  contexts  and 
abstract  contexts ,  involving  abstract  objects.  Then  valid  sentences/descriptions  say  which 
abstract  objects  are  present  in  the  context,  and  which  are  not.  Given  a  set  of  descriptions 
Di  C  D,  the  set  Dl  determines  a  formal  system  with  axioms  D{  and  inference  rules  3>. 
Hence,  we  introduce  formal  systems,  and  a  set  of  their  theories  T  is  equipped  with  an 
information  ordering  relation  <. 

Theories  (Tj),  when  associated  with  agents,  are  called  believed  theories  B,  and  there  is 
a  minimal  lattice  C  of  theories  that  includes  the  believed  theories,  but  also  contains  meets 
and  joins  of  the  believed  theories,  C  =  ClA,v(®)-  Such  lattices  provide  a  framework  for 
common  sense  knowledge  representation  and  reasoning.  In  particular,  given  such  a  lattice 
€,  it  captures  contradictions  and  partiality,  from  C  we  can  consider  C+  =  CD  {0, 1}.  If 
T2  >  T\  then  T\  is  more  partial  than  T2,  and  if  T2  V  Ti  =  1  then  the  theories  are 
contradictory.  We  also  have  that  if,  the  lattice  C+  is  a  concept  lattice  then,  theories  in 
C  and  sentences  in  D  can  be  partially  ordered,  and  a  numerical  measure  u  :  T  — >  [0, 1] 
can  be  derived.  Hence,  given  that  theories  can  be  ordered  (partially  ordered,  linearly 
ordered  by  their  numeric  measure),  we  can  derive  preference  relations  on  theories  which 
allows  us  to  decide  which  information  to  accept  or  reject,  or,  more  generally,  how  to  order 
information,  which  in  our  case  is  expressed  by  theories. 

The  theoretical  foundations  of  Conceptual  Reasoning  are  presented.  We  propose 
partial  abstract  contexts  as  partial  models  of  worlds  consisting  of  objects  having  attributes. 
Further,  we  defined  formal  systems  which  allow  us  to  find  sentences  (descriptions)  that 
follow  from  a  given  set,  and  we  relate  the  two,  taking  into  account  that  the  set  of  contexts 
K  and  the  set  of  theories  T  are  sets  equipped  with  their  information  orderings. 

The  framework  allows  us  to  represent  and  reason  about  contexts  involving  objects  hav¬ 
ing  attributes.  Both  semantic  and  syntactic  information  about  such  contexts  is  considered. 
Models  correspond  to  contexts,  and  syntactic  information  gives  rise  to  theories  consisting 
of  sentences  provable  in  formal  systems.  We  then  consider  the  multiple  agent  case.  Given 
a  set  of  agents,  the  set  of  their  believed  theories  is  B,  and  the  resulting  lattice  is  C,  or  C+, 
if  we  include  an  empty  theory  0  and  an  “inconsistent  theory”  1.  We  show  how  one  should 
interpret  such  structures,  and  suggest  how  preference  relations  on  theories  can  be  derived. 
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We  then  focus  on  theories  and  consider  related  structures  which  allow  to  deal  with 
information  provided  by  multiple  agents.  As  an  illustration  of  the  formalism,  we  show 
how  conceptual  reasoning  can  be  applied  in  the  multi-sensor  fusion  domain.  The  complete 
working  of  the  example  is  provided  as  an  appendix  to  this  report. 


DSTO-RR-0118 


Authors 


Peter  Deer 

Information  Technology  Division 

Peter  Deer  is  a  Senior  Professional  Officer  in 
Information  Technology  Division.  He  joined 
DSTO  in  1989  after  16  years  in  the  Australian 
Regular  Army.  He  pursues  research  interests  in 
logic  and  human  reasoning,  and  digital  image 
processing  using  remotely  sensed  data. 


Peter  W.  Eklund 

The  Department  of  Computer  Science 
The  University  of  Adelaide 

Peter  Eklund  is  a  Senior  Lecturer  in  Computer 
Science  at  the  University  of  Adelaide,  where  he 
teaches  Artificial  Intelligence  and  Logic 
Programming.  He  has  recently  been  appointed  as 
Foundation  Professor  of  Information  Technology 
at  Griffith  University. 


Chris  Nowak 

The  School  of  Mathematics,  Physics,  Computing 
and  Electronics 
Macquarie  University 

Chris  Nowak  is  a  Research  Associate  at  the  School 
of  Mathematics,  Physics,  Computing  and 
Electronics  at  Macquarie  University.  His  research 
interests  are  AI  logic  and  mathematical  algebra. 
He  has  recently  completed  a  PhD  in  Computer 
Science  at  the  University  of  Adelaide. 


DSTO-RR-0118 


Contents 

1  INTRODUCTION  1 

1.1  Structure  of  the  Report .  1 

1.2  Methodology .  1 

1.3  Multiple  Agencies .  1 

1.4  Information  Retrieval .  3 

1.5  Mathematical  Foundations .  4 

1.6  Data  Fusion .  4 

1.7  A  Study  of  the  Organisational  Structure .  6 

2  CONCEPTUAL  REASONING:  BACKGROUND  7 

2.1  Formal  Concept  Analysis .  7 

2.2  Fundamental  Theorem  of  Concept  Lattices .  8 

3  CONCEPTUAL  REASONING:  THEORETICAL  FOUNDATIONS  11 

3.1  Partial  Abstract  Contexts  .  11 

3.2  Formal  Theories .  13 

3.3  Contexts  and  theories .  15 

3.4  Multiple  agents .  16 

4  INTELLIGENCE  ANALYSIS  AND  CONCEPTUAL  REASONING  21 

4.1  Example:  Multi-sensor  Fusion .  21 

4.2  Incorporation  of  Database  Knowledge .  24 

5  CONCLUSION  27 


References 


28 


DSTO-RR-0118 


1  INTRODUCTION 

1.1  Structure  of  the  Report 

Section  1  discusses  the  broad  approach  of  Conceptual  Reasoning  and  its  applications 
to  the  defence  science  domain.  Formal  concept  analysis  is  introduced  in  Section  2.1  as  the 
necessary  background  for  the  development  of  conceptual  reasoning.  The  report  develops 
the  theory  of  Conceptual  Reasoning  in  Section  3.  A  proof-theoretic  account  is  offered  in 
Section  3.2.  Contexts  are  related  to  theories  in  Section  3.3.  Multiple  agency  is  addressed 
in  Section  3.4  and  an  example  follows  in  Section  4  in  the  multi-sensor  fusion  domain. 
Issues  regarding  the  pragmatics  of  the  technique  are  also  examined  in  this  section.  The 
fully  worked  solution  to  the  example  presented  in  Section  4  is  offered  in  an  appendix. 

Many  standard  techniques  in  engineering  have  been  derived  from  early  work  in  Ar¬ 
tificial  Intelligence  (AI).  Neural  classifiers  [HP91],  fuzzy  controllers  [DH94],  genetic  algo¬ 
rithms  [Hol75],  classifier  systems  [Gol89]  and  knowledge  and  data  discovery  techniques  [FU95] 
all  have  evolved  from  early  AI  research  but  are  now  mainstream  engineering.  The  core 
AI  literature  is  increasingly  distancing  itself  from  pragmatic  tools,  concentrating  on  the¬ 
oretical  features  of  disembodied  intelligence  [IJC95,  AAA96,  KR96]  and  commonsense 
reasoning.  This  ignores  a  pragmatic  agenda,  a  convergence  of  computational  intelligence 
and  AI  as  a  recognised  engineering  discipline.  Such  a  convergence,  if  it  were  to  be  achieved, 
could  provide  a  useful  grab-bag  of  problem  solving  techniques  for  intelligent  systems.  We 
consider  this  goal  highly  desirable. 

The  aim  of  this  paper  is  to  present,  in  formal  terms,  the  foundations  of  conceptual 
reasoning.  Additionally,  we  give  illustrations  of  potential  applications  of  value  in  the 
defence  science  domain. 


1.2  Methodology 

Conceptual  reasoning  [Now97]  described  in  this  report  is  not  mainstream  AI,  but  it 
borrows  heavily  from  mainstream  AI  methodology  [GN87].  It  deals  with  default  or  partial 
reasoning  and  multiple  agencies,  and  uses  logical  foundations  commonly  used  in  AI  logic 
research.  It  constructs  a  syntactic  and  semantic  interpretation  of  multiple  agencies  (or 
worlds)  unified  via  a  soundness  and  completeness  result. 


1.3  Multiple  Agencies 

What  is  novel  is  the  structure  and  ordering  of  implicit  knowledge  about  the  world  ac¬ 
cording  to  order-theoretic  principles.  For  example,  since  signal  or  sensor  input  often  occurs 
as  phenomena  paired  with  several  features,  a  useful  approach  to  structuring  information 
sources  is  to  deal  with  formal  concepts,  discussed  in  the  background  section  on  page  7. 

These  formal  concepts  represent  a  cluster  of  attributes  in  which  it  would  serve  no 
useful  purpose  to  distinguish.  For  example,  in  the  UK,  a  precursor  to  a  green  light  is  a 
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flashing  amber  signal.  Why  is  a  warning  signal  necessary  for  a  motorist  starting  from  rest 
to  change  to  a  moving  position?  Unless  construed  as  a  wake  up  call  to  the  driver,  the 
amber  elicits  no  response  or  action.  It  therefore  has  no  information  content.  The  amber 
is  paired  implicitly  with  the  impending  green  light  and  signals  the  driver  to  motion.  The 
example  is  anecdotal  but  it  serves  our  purpose. 

Another  example  derives  from  Australian  newspapers.  Since  Australian  newspapers 
tend  to  be  controlled  and  run  by  only  a  few  individuals,  there  is  some  content  repetition  in 
titles.  Take  The  Australian  and  The  Adelaide  Advertiser,  they  often  run  identical  stories 
and  even  images.  If  we  consider  each  newspaper  article  as  an  agent,  then  both  agents  may 
report  identically.  The  relative  information  content  of  the  second  is  zero  so  we  cluster  both 
articles  and  their  sources  to  the  same  source  since  they  represent  the  same  world  view. 

The  collapse  of  multiple  agreeing  agencies  may  only  be  important  in  terms  of  the 
cardinality  of  the  agreeing  sources.  If  10  sources  report  an  incident  X  and  2  report 
something  other  than  X  (or  nothing  at  all),  this  may  represent  the  formation  of  a  cartel 
for  the  belief  of  X.  If  cardinality  can  be  interpreted  as  evidence  in  favour  of  X,  there  may 
be  overwhelming  evidence  for  X  over  something  other  than  X. 

A  more  interesting  situation  is  where  multiple  sources  indicate  immediate  or  partial 
conflict.  Where  agents  agree  or  disagree  can  be  visualised  as  a  partial  order  and  this  order 
represents  both  the  inter-dependence  of  causal  assumptions  as  well  as  the  universal  or 
agreed  truths  between  agents.  With  conceptual  reasoning,  both  contradictions,  as  well  as 
agreement,  can  be  isolated  and  graphically  rendered.  This  rendering  represents  one  of  the 
key  benefits  of  conceptual  reasoning. 

In  terms  of  newsfeeds,  many  of  the  formal  techniques  in  conceptual  reasoning  rely  on 
a  suitable  translation  of  natural  language  to  an  agreed  inter-lingua  represented  in  logical 
terms.  Each  new  report  represents  a  theory  and  these  theories  are  ordered  in  the  same 
way  as  the  paired  signals  above.  This  is  perfectly  tractable  but  relies  on  an  appropriate 
representation  of  the  theories  in  an  agreed  language  sourced  from  the  newsfeeds.  This  is  a 
difficult  problem.  Since  there  is  no  unified  theory  of  intention  in  natural  language  [RN95], 
there  are  only  two  current  possibilities  for  automated  reasoning  of  this  type. 

1.  The  first  is  a  coarse  machine  translation  to  a  universal  logic  such  as  predicate  cal¬ 
culus.  However,  automated  machine  translation  is  an  even  more  difficult  problem. 
Such  a  translation  will  not  only  be  flawed  in  terms  of  its  inability  to  detect  idioms, 
nuances  and  intentions  (especially  in  deceptive  sources)  but  worse  still,  since  the 
predicate  calculus  is  semi-decidable,  we  can  never  guarantee  that  a  non-theorem 
does  not  follow. 

2.  Secondly,  we  could  hand-craft  newsfeeds  into  a  tractable  logical  language,  that  should 
have  the  properties  of  soundness  and  completeness,  say  a  description  logic  based 
on  Knowledge  Interchange  Format  (KIF)  [GFB+92]  or  (a  subset)  of  conceptual 
graphs  [Sow83].  This  would  be  an  impossible  task  for  the  human  analyst  even 
for  the  most  impoverished  provincial  newspapers.  It  would  also  lack  the  presenta¬ 
tional  adequacy  of  the  original  source,  not  everything,  therefore,  could  be  faithfully 
transcribed  in  the  logical  language  and  some  of  the  information  content  would  be 
lost  [Gin93]. 
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The  idea  of  allowing  the  analyst  to  perform  knowledge  markup  has  been  used  by 
Philippe  Martin  and  others  [Mar95,  MA96,  Mar96].  Martin  uses  a  knowledge  markup 
language,  based  on  conceptual  structures,  that  allows  the  user  to  embed  representation 
sentences  within  text  documents.  These  sentences  can  then  be  used  to  navigate  text  or 
other  documents  elements,  that  is  they  can  be  used  to  hyperlink  the  source.  Addition¬ 
ally,  the  mark  up  language  can  be  used  to  make  new  inferences.  Say  we  have  two  legal 
terms,  “dissolution  of  company  partnership”  and  “divorce  settlement”.  These  two  ideas 
combine  to  form  the  conjunction  (or  join),  “divorcing  partners  who  also  have  a  company 
partnership” .  The  join  of  the  first  two  can  be  used  to  search  for  instances  of  the  join  in 
case  law. 


1.4  Information  Retrieval 

An  alternative  to  both  machine  translation  and  knowledge  markup  is  to  concentrate 
on  efficient  mechanisms  to  retrieve  information  on  the  basis  of  content  addressibility. 

This  approach  places  greater  emphasis  on  the  human  analyst  who  must  draw  the  appro¬ 
priate  inferences  from  the  information  retrieval  process.  This  emphasis  can  be  minimised 
by  providing  an  inference  engine  that  the  analyst  uses  to  select  suitable  facts  from  news 
sources  and  placing  them  into  a  “sheet  of  assertion”.  This  sheet  represents  those  facts 
extracted  from  the  database  which  are  meaningful  to  the  analytic  task.  Relevant  facts 
can  be  combined  to  draw  conclusions.  In  this  sense,  inferences  can  be  guaranteed  to  be 
sound  but  in  no  way  complete.  This  approach  presents  the  most  promising  and  tractable 
paradigm  to  intelligence  analysis. 

Most  information  retrieval  (IR)  relies  on  keyword  boolean  search,  vector  space  models 
or  n-grams  [Dam95]  as  a  mechanism  for  measuring  document  similarity  [WMB94].  Con¬ 
ceptual  structures  [Sow83],  although  not  conceived  as  an  aid  for  information  retrieval  can 
be  used  as  such.  Conceptual  structures  are  one  of  a  number  of  candidate  knowledge  rep¬ 
resentation  languages  that  rely  heavily  on  order  sorted  relations  to  describe  key  concepts 
and  relation  types.  A  taxonomy  of  terms,  as  concepts  (such  as  animate- object  >  vehicle 
>  car  >  BMW  >  BMW#12S)  or  connecting  relations  (such  as  relationship  >  parent  > 
mother  >  single-mother  >  single-mother-one-child  >  single-mother- one- child (mary,  tom)) 
can  be  defined  and  these  taxonomies  aid  in  the  formation  of  partial  orders  of  sentences. 
For  example,  when  sufficiently  sanitised,  sentences  in  natural  language  can  be  visualised 
as  a  partial  order  or  taxonomy  of  sorted  data  from  unstructured  text  input.  This  ignores 
the  semantic  meaning  of  the  sentences  but  orders  them  according  to  their  interconnected 
relations  and  concept  types. 

The  importance  of  this  idea  is  that  it  allows  information  retrieval  (IR)  to  be  based 
not  just  on  boolean  keyword  or  vector  space  similarity,  but  also  on  the  structural  content 
of  the  information  itself;  and,  in  so  far  as  semantics  can  be  determined  from  structure, 
through  the  use  of  taxonomies  of  relations  and  concept  types,  meaning  can  be  extracted. 
Furthermore,  partial  matches  on  specific  information  queries  can  be  recalled.  Precision  of 
the  information  request  is  also  thought  to  be  improved  since  recall  is  based  on  either  a 
specialisation  or  generalisation  of  the  information  request.  This  approach  to  IR  is  called 
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order-sorted,  or  knowledge  retrieval  and  is  closely  related  to  the  literature  on  terminological 
logics  [BFH+94]  (sometimes  called  description  logics). 

In  the  United  States,  a  company  called  Textwise  (www.textwise.com)  developed  the 
first  search  engine  to  capitalise  on  this  idea.  Their  search  engine,  called  DR  LINK,  is  now 
being  used  in  the  US  Patient  office  and  DoD  agencies  for  IR  against  technical  abstracts  and 
other  unstructured  data.  However,  DR  LINK  is  based  on  a  carefully  engineered  taxonomy 
of  parts  of  speech  [LJ91],  a  so  called  sub-grammar  ontology.  Therefore  its  precision,  in 
classical  IR  terms,  is  relatively  poor. 

Other  companies  such  as  the  CYC  Corporation  (www.cyc.com)  have  been  develop¬ 
ing  more  general  taxonomies  of  concepts  and  relations  and  companies  such  as  Infoseek 
(www.infoseek.com)  and  Yahoo  (www.yahoo.com)  have  developed  Internet  search  engines 
based  on  ontologies  that  partition  the  Internet  into  various  corpora  of  subject  matter. 
There  are  several  ANSII  standard  organisations  addressing  the  issue  of  generalised  term 
taxonomies  [Pe93].  Apart  from  CYC,  none  we  know  suggest  synthesising  term  hierarchies 
from  the  data  sources  themselves,  i.e.  via  knowledge  and  data  discovery  techniques.  A 
key  premise  reinforcing  our  work  is  that  unstructured  text  sources  can  themselves  be  the 
sources  for  term  hierarchies  necessary  for  knowledge  retrieval. 


1.5  Mathematical  Foundations 

Conceptual  reasoning,  presented  in  this  paper  formally,  combines  and  extends  the  work 
of  two  Mathematics  Professors,  Peter  Burmeister  [Bur89]  and  Bernhard  Ganter  [Gan96] 
from  the  Darmstadt  group  in  Germany.  It  demonstrates  how  a  natural  preference  order¬ 
ing  can  be  synthesised  on  propositional  statements  from  various  agents.  The  resulting 
formal  framework  provides,  among  other  things,  the  capacity  to  visualise  the  process  of 
assessing  shared  beliefs  about  the  world,  the  so  called  common-knowledge  that  agents 
share.  Additionally,  it  can  isolate  knowledge  between  agents  that  is  contradictory  and 
will  recommend  the  cleanest  way  to  resolve  such  conflicts  through  retracting  agent  beliefs. 
Nowak’s  work  [Now97]  represents  the  extreme  end  of  the  continuum  between  applications 
of  formal  concept  analysis  [Wil92],  and  computational  intelligence.  Conceptual  reasoning 
is  much  closer  to  traditional  symbolic  AI  but  has  a  strong  theoretical  connection  to  general 
algebra  and  lattice  and  order  theory  that  importantly,  unlike  some  other  belief  revision 
and  nonmonotonic  reasoning  frameworks,  imposes  a  natural  ordering  on  beliefs. 


1.6  Data  Fusion 

In  almost  all  respects,  conceptual  reasoning,  for  the  task  of  processing  and  interpreting 
the  implications  of  text-based  information  sources,  is  5  years  from  the  intelligence  analyst’s 
desktop.  The  problems  of  engineering  a  suitable  knowledge  retrieval  framework  for  text- 
based  sources  is  a  more  pressing  pre-requisite  for  the  success  of  the  approach  and  will  take 
considerable  engineering  and  research  effort.  However,  the  conceptual  reasoning  framework 
may  prove  to  be  of  value  when  presented  with  multiple  and  ambiguous  signal  processing 
inputs  in  the  sensor  and  data  fusion  task  or  for  the  analysis  of  organisational  structure. 
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Data  fusion  is  the  activity  in  which  related  data  from  multiple  sensors  or  sources  is 
combined  to  provide  enhanced  quality  and  availability  of  information  over  that  which  is 
available  from  any  individual  sensor  or  source.  There  have  been  various  architectures 
proposed  for  data  fusion,  but  the  commonly  held  view  is  that  the  fusion  process  can  be 
divided  into  a  number  of  levels.  For  example,  the  modified  US  JDL  Model  breaks  down  the 
process  of  data  fusion  in  the  military  context  into  four  levels,  namely  object  refinement, 
situation  refinement,  threat  refinement  and  process  refinement  —  see  [WL90]  and  [NM96]. 

Object  refinement  is  an  iterative  process  of  fusing  data  to  determine  the  identity  and 
other  attributes  of  entities  and  also  build  tracks  to  represent  their  behaviour.  The  product 
from  this  level  is  called  the  situation  picture.  Situation  refinement  is  an  iterative  process 
of  fusing  the  spatial  and  temporal  relationships  between  entities  to  group  them  together 
and  form  an  abstracted  interpretation  of  the  distribution  of  forces.  The  product  from 
this  level  is  called  Situation  Assessment.  Threat  Assessment  is  an  iterative  process  of 
fusing  the  combined  activity  and  capability  of  enemy  forces  to  infer  their  intentions  and 
assess  the  threat  they  pose  to  Own  and  allied  forces.  The  product  from  this  level  is  called 
Threat  Assessment.  Finally,  Process  Refinement  is  an  iterative  process  of  improving  the 
products  from  other  fusion  levels.  The  performance  is  monitored  and  when  it  degrades 
sufficiently  the  collection  plans  are  adapted  so  that  the  necessary  sensor  and  source  data 
can  be  obtained.  This  is  not  a  fusion  process  in  itself,  but  is  an  integral  part  of  any  data 
fusion  system.  Results  from  a  higher  level  can  also  be  used  to  indirectly  influence  the 
fusion  process  in  lower  levels. 

Situation  assessment  has  meaning  at  the  tactical,  operational  and  strategic  level.  A 
complete  understanding  of  the  theatre  over  time  may  reveal  the  tactical  intentions  of  the 
enemy  but  it  may  be  impractical  to  undertake  in  real-time.  Alternatively,  conceptual  rea¬ 
soning  could  also  be  used  as  a  representational  approach  in  order  to  assess  previously 
collected  kinematic  and  attribute  operational  data  and  organising  that  data  using  unsu¬ 
pervised  machine  learning.  In  much  the  same  way  as  this  approach  can  be  used  to  examine 
chess  games  to  isolate  tactical  chunks,  so  too  conceptual  reasoning  can  be  used  to  isolate, 
and  later  recognise,  tactical  threats. 

Above  this  architecture  for  data  fusion,  our  interest  is  in  optimising  resource  utilisation. 
The  analysis  of  historical  theatre  data  can  be  used  to  determine  if  resources  were  used 
optimally  or  sub-optimally.  A  re-organisation  of  the  resource  allocation  during  operational 
manoeuvres  will  reveal  the  types  and  source  of  data  required  to  perform  real-time  oper¬ 
ational  assessment  through  a  static  analysis  of  the  historical  theatre.  Again,  approaches 
similar  (or  identical)  to  conceptual  reasoning  may  be  appropriate  to  this  task. 

The  key  notion  reinforcing  these  possibilities  is  an  answer  to  the  question:  can  a  cross 
table  or  context  be  created  from  the  input  data  sources?  In  data  fusion,  the  creation  of  the 
formal  context  needs  to  be  tied  to  the  physics  of  the  sensor  device(s).  Transitions  between 
states  may  need  explanation  and  this  gives  rise  to  considerable  complexity  between  states 
of  the  sensor,  their  explanation  and  points  in  time. 

One  general,  and  incorrect  assumption,  concerning  conceptual  reasoning,  and  formal 
concept  analysis  more  generally,  is  that  it  can  not  represent  time  points  or  intervals:  it 
can.  Contexts  can  be  created  for  various  timepoints  or  intervals  and  the  inter-connection 
between  these  contexts  examined  [Wil96]. 
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1.7  A  Study  of  the  Organisational  Structure 

Structure,  and  the  visualisation  of  structure,  is  the  main  selling  point  of  conceptual 
reasoning  and  formal  concept  analysis.  The  capacity  to  visualise  and  explain  structure 
and  intentions  through  lattice  diagrams  is  the  key  to  developing  an  understanding  of  an 
analytical  domain.  Such  visualisation  capabilities  can  be  used  to  expose  flaws  and  weak¬ 
nesses  in  reasoning  and  organisation.  There  are  three  ways  we  see  this  idea  being  manifest: 
(i)  resource  inventory;  (ii)  lines  of  command  and  communication;  (iii)  the  vocabulary  for 
command  and  control.  All  relate  to  formal  concept  analysis  in  the  first  instance,  but 
could,  if  so  desired,  be  made  more  sophisticated  to  take  into  account  the  conceptual  rea¬ 
soning  framework  through  the  modelling  of  the  object’s  internal  goals  or  intentions  as 
agent  theories. 

The  first  is  relatively  straightforward.  It  is  easy  to  imagine  a  cross  table  (such  as 
the  one  on  page  8)  containing  all  operational  units  and  the  resources  (or  capabilities)  at 
their  disposal.  How  those  units  cluster  in  the  concept  lattice  tells  us  something  about 
the  command/capability  relationship.  Secondly,  lines  of  command  and  structure  can  be 
built  into  a  formal  concept  lattice,  the  natural  and  intended  structure  of  the  organisation 
should  be  revealed  by  that  process.  The  process  would  not  be  expected  to  say  much 
about  a  carefully  organised  command  structure,  but,  if  and  when  there  are  ambiguities, 
these  can  be  isolated  and  resolved  with  little  discussion.  In  this  respect,  a  mechanised 
and  formal  analytical  process  such  as  formal  concept  analysis  (or  conceptual  reasoning) 
has  great  advantages  in  defusing  political  debate.  Dispute  is  minimised  when  organisation 
structure  can  be  expressed  as  crosses  in  a  matrix.  The  interpretation  of  the  synthesised 
structure  is,  once  again,  unambiguous. 

Finally,  the  study  of  the  structure  and  organisation  of  command  and  control  languages 
is  an  important  element  of  the  efficiency  and  battle-readiness  of  the  military.  Formal 
concept  analysis  provides  a  tool  for  such  analysis.  Frank  Vogt  [Vog97]  has  shown  how 
formal  concept  analysis  can  be  used  as  an  aid  in  communication  for  the  process  of  software 
engineering.  He  shows  how  “problem” ,  “design”  and  “implementation”  cross  tables  can  be 
created  representing  multiple  and  different  views  of  the  engineering  process.  The  effect  of 
using  formal  concept  analysis  in  this  way  is  to  reveal  a  structure  that  directly  isolates  the 
project  priorities  through  task  inter-dependence.  Since  different  views  of  the  operational 
unit’s  capabilities  are  similarly  defined  in  the  military  domain,  this  analytic  process  will 
once  again  have  the  effect  of  identifying  in  precise  terms  the  priorities  of  the  operational 
unit. 

The  prospects  for  the  application  of  conceptual  reasoning  in  the  military  domain  are 
excellent.  However,  before  we  can  generate  a  capability  with  this  technology,  experience 
needs  to  be  built  using  formal  concept  analysis  as  the  starting  point. 

We  now  give  the  detailed  formalism  starting  with  an  introduction  to  formal  concept 
analysis. 
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2  CONCEPTUAL  REASONING: 
BACKGROUND 

2.1  Formal  Concept  Analysis 

Formal  Concept  Analysis  is  a  theory  of  concept  formation  derived  from  lattice  and 
order  theory.  In  Engineering  and  AI  terms  it  is  an  unsupervised  learning  technique. 

The  principal  proponents  of  Formal  Concept  Analysis  (FCA)  can  be  found  in  the  Fach- 
bereich  Mathematik  at  the  Technische  Hochschule  Darmstadt  in  Germany.  FCA  is  inspired 
by  Birkhoff ’s  work  in  Lattice  Theory  from  the  1930s  and  40s  and  studies  in  Universal  Alge¬ 
bra  by  Gratzer  from  the  early  1970s.  An  excellent  reading  in  the  Introduction  to  Lattices 
and  Order  is  given  by  Davey  and  Priestley  [DP90].  Definitive  papers  on  the  subject  of 
FCA  by  its  inventor  Rudolf  Wille  are  [Wil82,  Wil92,  GW96]. 

FCA  asks  the  question,  what  is  a  concept?  One  answer  is  that  a  concept  is  determined 
by  its  intent  and  extent.  The  extent  describes  all  the  objects  in  the  universe  that  belong 
to  a  concept,  e.g.  the  set  of  all  “red  Hondas”,  mine,  yours,  the  guy’s  down  the  street,  the 
one  that  just  drove  past.  The  intent  is  the  collection  of  all  attributes  shared  by  a  set  of 
objects,  e.g.  the  set  of  all  red  Hondas  use  fuel,  they  are  all  cars,  they  are  all  designed  in 
Japan,  presumably  they  all  have  radios,  wheels,  gears  and  so  on. 

Because  a  concept  can  have  many  instances,  and  the  set  of  all  instances  is  an  almost 
limitless  set  of  shared  attributes  of  one  sort  or  another,  it  is  customary  to  work  with 
a  specific  context  in  which  both  the  set  of  objects  (as  ground  instances)  and  attributes 
(or  characteristics)  are  fixed.  One  of  the  profound  research  questions  relevant  to  FCA  is 
whether  or  not  it  can  be  used  when  contexts  are  “open”  or,  in  AI  terms,  informationally 
incomplete.  In  simple  terms,  conceptual  reasoning  considers  whether  many  contexts  can 
be  analysed  to  determine  the  extent  to  which  they  represent  a  coherent  set  of  multiple- 
agent  beliefs.  Wille  himself  has  considered  this  question  [Wil96].  The  difference  between 
Nowak’s  and  other  work  is  the  use  of  an  abstract  intent,  which  can  allow  for  a  countably 
infinite  set  of  objects  to  be  dealt  with,  and  the  use  of  multiple  description  sets.  Nowak’s 
approach  is  a  model-theoretic  AI  approach  which  exploits  the  lattice-based  “structure”  of 
concept  clusters  but  deals  with  them  as  members  of  an  object  language  in  logic. 

The  best  way  to  understand  FCA  is  to  consider  a  simple  example.  In  FCA,  we  al¬ 
ways  build  a  “cross  table”  or  context  in  which  all  the  objects  and  their  attributes  are 
enumerated.  The  following  example  can  be  found  in  Davey  and  Priestly’s  book  on  page 
221. 

In  this  example,  objects  are  Planets  in  our  solar  system.  Planets  have  attributes  or 
attributes  that  are  fixed  in  terms  of  their  distance  from  the  sun,  their  size  and  whether  or 
not  they  have  a  moon(s).  In  table  1,  the  object  in  the  ith  row  possesses  the  attribute  in 
the  jth  column  exactly  when  the  (i,  j)th  cell  is  marked  with  an  x.  A  concept  is  an  ordered 
pair  (A,  B )  where  A  is  a  subset  of  the  9  planets  of  the  solar  system  and  B  is  the  set  of  all 
attributes  shared  by  the  objects  in  A.  This  also  means  that  A  is  the  set  of  all  objects  that 
possess  each  of  the  attributes  in  B.  This  means  that  the  formal  concepts  denoted  (A,  B) 
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SIZE 

DISTANCE 

MOON 

small  medium  large 

near  far 

yes  no 

Mercury 

X 

X 

X 

Venus 

X 

X 

X 

Earth 

X 

X 

X 

Mars 

X 

X 

X 

Jupiter 

X 

X 

X 

Saturn 

X 

X 

X 

Uranus 

X 

X 

X 

Neptune 

X 

X 

X 

Pluto 

X 

X 

X 

Table  1:  A  cross  table  for  the  Solar  system. 


consist  of  just  those  objects  with  a  set  of  attributes  in  B.  For  example,  take  the  object 
Earth  and  consider  its  attributes; 

B  =  {small,  near,  yes}. 

Now  ask,  what  are  the  other  planets  that  possess  all  the  attributes  in  B?  The  answer  is 
Mars.  So  one  concept  in  this  context  is  {{Earth,  Mars},  {small,  near,  yes}}.  The  concept 
has  as  its  extension  of  the  set  of  planets  {Earth,  Mars}  and  as  its  intention  of  the  set  of 
attributes  {small,  near,  yes}. 

Note  the  other  concepts  that  result  from  this  context: 


{{Mercury,  V enus },  {small,  near,  no}}-, 

{{Jupiter,  Saturn},  {large,  far,  yes}}; 

{{Uranus,  Neptune},  {medium,  far,  yes}}; 

{{Pluto},  {small,  far,  yes}}. 

Thus,  although  there  are  7  attributes  and  9  objects,  there  are  only  5  distinct  formal 
concepts. 

It  is  also  usual  to  regard  a  concept  as  more  general  than  another  if  its  extent  is  a 
subset  of  the  other’s  concept  extent.  This  means  we  can  define  an  order  on  concepts 
(AuB2)  <  (. A2,B2 )  iff  Ax  is  a  subset  of  A2.  This  results  in  a  partial  ordering  over 
concepts  which  turns  out  to  have  the  attributes  of  a  complete  lattice. 


2.2  Fundamental  Theorem  of  Concept  Lattices 
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A  context  is  a  triple  (G,  M,  I)  where  G  and  M  are  disjoint  sets  and  I  is  a  subset  of 
the  Cartesian  product  of  G  and  M,  i.e.  G  x  M.  The  elements  of  G  and  M  are  objects  and 
attributes.  An  object  g  has  the  property  m,  denoted  glm  iff  (y,  m)  G  I.  The  reason  that 
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G  and  M  are  so  named  is  that  they  are  derived  from  the  German  for  object  ( Gegenstande ) 
and  M  for  attribute  ( Merkmale ). 

For  A  C  G  and  B  C  M,  define  A'  =  {m  €  M  \  glm}  and  B'  =  {g  €  G  | 

Vm€ b  gltn}-  Hence,  A!  is  the  set  of  all  attributes  common  to  the  objects  in  A  and  B' 
is  the  set  of  all  processing  the  properties  in  B.  A  formal  concept  is  a  pair  ( A,B )  of  the 
context  (G,  M,  I)  such  that  A'  =  B  and  B'  =  A. 

The  set  of  all  formal  concepts  of  ( G,M,I )  is  denoted  by  B(G,M,I).  Again,  following 
the  German  traditions  of  the  formalism,  the  B  denotes  the  German  “Begriff”  which  roughly 
translates  as  “description”. 

For  concepts  (A\,Bi)  and  ( A2,B2 )  in  B(G,M,I)  we  write  (Ai,Bi  )  <  (A2,B2)  if 
Ai  C  A2.  An  important  theoretical  result  is  that  this  turns  out  to  be  equivalent  to 
requiring  B2  D  Bj,  This  implies  that  the  structure  (B(G,  M,  /),<)  is  a  complete  lattice, 
called  the  concept  lattice  of  B  (G,M,I). 

Concepts  are  placed  in  a  lattice  structure  in  which  the  meet  and  join  of  any  combina¬ 
tion  of  elements  are  given  by  definition.  This  concept  lattice  not  only  contains  concepts 
corresponding  to  each  object  but  also  concepts  corresponding  to  the  meet  and  join  of  other 
concepts.  The  lattice  can  express  all  relationships  between  objects  and  properties.  For 
example,  the  lattice  can  represent  the  fact  that  if  an  object  has  one  attribute,  then  it  must 
possess  all  attributes  lying  above  this  node  in  the  lattice.  It  is  the  capability  to  express 
such  relationships  that  makes  the  lattice  a  powerful  algebraic  structure. 


T 


Figure  1:  The  formal  concept  lattice  for  Table  1. 
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For  example,  if  we  refer  to  the  context  described  in  the  table  above,  we  can  look  at 
the  midpoint  of  the  lattice  and  the  fundamental  theorem  tells  us  that  we  can  determine 
that  this  midpoint  is  ({Earth,  Mars,  Pluto},  {small,  yes}). 

The  concept  lattice  provides  a  basic  analysis  of  a  context,  it  yields  an  appropriate 
classification  of  objects  and  at  the  same  time  indicates  the  implications  between  properties. 
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3  CONCEPTUAL  REASONING: 
THEORETICAL  FOUNDATIONS 


3.1  Partial  Abstract  Contexts 


A  context  in  Formal  Concept  Analysis  (FCA),  see  e.g.,  [DP90],  is  defined  as  a  triple 
K  =  (G,  M,  I),  where  G  is  a  set  of  objects,  M  is  a  set  of  attributes,  and  I  is  an  incidence 
function  associating  objects  with  attributes  where  G  n  M  =  0  and  I  :  G  x  M  — >■  {0, 2}  is 
to  be  interpreted  as  follows. 

J(  ,  _  J  2  if  g  has  m , 

\9im)  |  q  ^  g  doeg  not  have  m.  * 


Refer  to  such  contexts  as  standard  FCA  contexts.  It  is  natural  to  consider  partial ,  or 
three-valued  contexts,  where  the  incidence  function  allows  partially  specified  (or  partially 
known)  objects;  in  this  case  I :  G  x  M  — >  {0, 1,2}  is  to  be  interpreted  as  follows: 


I{g,m)  =  I 


2 

0 

1 


if  g  is  known  to  have  m, 
if  g  is  known  not  to  have  m, 
otherwise. 


Apart  from  the  given  set  of  attributes  P  =  {p\, . . .  ,pn),  one  might  want  to  include  the 
corresponding  negated  attributes  denoted  by  P  =  {pj,  ■  ■  ■  ^Pn}■  We  assume  that  this  is  the 
case,  so  M  =  PU  P.  It  is  then  required  that  I(g,  m)  =  2  iff  I(g,m)  =  0,  and  I(g,  m)  —  1 
iff  I(g,m)  =  1.  We  want  to  deal  with  such  partial  contexts. 

However,  it  is  often  problematic  to  uniquely  identify  objects.  Hence,  given  a  set  of 
attributes  M,  we  employ  a  set  of  abstract  objects — these  can  be  associated  with  sets  of 
indiscernible  objects.  First,  we  introduce  a  set  F  of  formulae,  given  as  follows. 


F  =  {F  C  M  |  VPGP  F  2  {P,P}} 


Abstract  objects  can  be  associated  with  formulae.  If  F  6  F  then  we  define  the  abstract 
object  gF  to  be  the  superset  of  G  which  has  exactly  the  set  F  as  its  set  of  attributes. 
Hence,  the  set  G  of  all  abstract  objects. 

G  =  {gF  |  F  e  F} 

If  gF  G  G  then  gF  is  (properly)  partial  iff  \F\  <  |P|,  otherwise  it  is  total.  Further,  G  can 
be  seen  as  a  set  equipped  with  an  information  ordering  relation  <  given  by  gF  <  9f2  iff 
Fi  C  F2. 

Let  Gi  C  G.  Gi  determines  a  context  Ki  =  (Gt,  Mi,  A)  -  assume  that  M,  is  determined 
by  the  set  of  attributes  of  the  objects  of  Gi,  and  note  that  the  objects  also  specify  the 
incidence  relation  /,.  Then  K,  is  referred  to  as  an  abstract  context.  Note  also  that  because 
Gi  can  include  partial  objects,  Ki  is  partial.  Let  G  denote  the  powerset  of  G,  i.e.,  G  = 
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V(G).  Then  every  element  of  G  determines  an  abstract  context.  The  set  K  of  all  abstract 
context  (over  the  fixed  M)  is  denoted  by 

K  =  {Ki  =  ( G{ ,  Mj,  If)  |  Gi  G  G}. 

An  example  of  an  abstract  context  is  presented  in  Table  2,  in  a  form  of  a 
table” — if  an  object  is  known  to  have  m  (known  to  not  have  m)  then  this  is  denoted  by 
+  sign  (by  —  sign),  otherwise  the  •  sign  is  used.  For  instance,  the  object  g p2f)]  has  the 
attributes  IsSedan  and  IsRed.  Abstract  contexts  can  be  used  to  represent  information 
about  a  world,  without  uniquely  identifying  objects — the  context  of  Table  2  represents  a 
world  in  which  there  are  “red  non-Fords”  and  there  are  “non-red  sedans,”  and  there  are 
no  other  objects. 


9F\20 

9  F201 

+  • 

1  + 

•  1 

K 

IsSedan  IsRed  IsFord 

Table  2:  Abstract  context — example 


The  set  K  can  be  equipped  with  an  information  ordering  defined  as  follows.  Assume 
a  fixed  M,  and  let  K\  and  K 2  be  abstract  contexts  with  sets  of  objects  G\  and  G 2, 
respectively.  Then  K\  <  K2  if  and  only  if  the  following  two  conditions  are  satisfied: 

L  yg2cG2  39leGi  9i  <  92 
V0ieGi  ^g2^G2  9\  — 

This  turns  K  into  a  partially  ordered  set  (K,  <).  Maximal  elements  of  K  are  called  total 
contexts  and  are  denoted  by  An  example  of  (IK,  <)  for  |P|  =  1  is  presented  in  Figure  2 — 

the  figure  shows  sets  of  abstract  objects,  but  these  determine  the  corresponding  contexts. 

In  the  example  of  Figure  2,  if  an  object  is  in,  outside,  on  border  of  the  circle,  then 
it  has,  does  not  have,  is  undetermined  wrt  p\.  There  are  four  maximal  elements,  one 
representing  an  empty  world — these  give  rise  to  total  contexts,  the  context  of  the  empty 
world  having  an  empty  set  of  objects.  There  are  two  minimal  elements,  one  representing 
a  nonempty  but  otherwise  unspecified  world,  the  other  representing  an  empty  world. 

Given  a  context  Ki  6  K  and  the  set  of  formulae  F.  A  formula  F  is  defined  to  be 
0-valid  iff; 

Ki  [=®  F  iffdef  %GGi  Vm€i?  Ii(g,m )  =  2 

Likewise  F  is  ©-valid  iff; 

Ki  He  F  iffdef  VgeGi  Ii  (g,m)  =  0 

Then,  define  a  set  D  of  descriptions,  or  sentences. 

D  =  F  x  {©,©} 
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Figure  2:  Information  ordering  on  contexts 


Descriptions  are  “marked  formulae”  D  can  be  viewed  as  {©F,  ©F  j  F  €  F}.  Validity  of 
descriptions  can  then  be  defined  in  terms  of  ©-  and  ©-validity.  We  say  that  D  is  valid  in 
K,  denoted  K  |=  D  iff  one  of  the  following  conditions  holds. 

D  =  ®F  and  K  |=©  F,  or 
D  =  QF  and  K  f=e  F. 

If  liC  is  a  context  then  we  say  that 

Tk  =  {D  e  D  |  K  (=  D} 


is  a  theory  of  K. 


3.2  Formal  Theories 


Suppose  that  a  set  D{  of  descriptions  is  given,  i.e.,  D{  C  D.  The  intention  is  that  D% 
is  a  set  of  descriptions  valid  in  some  context.  We  propose  formal  systems-,  given  a  set  Di 
a  formal  system  "Hi  allows  us  to  find  descriptions  that  follow  from  Di. 

The  following  set  $  =  <^3,  ¥>4}  of  inference  rules  is  employed. 


<pl  ■ 

®FU{m} 

<P2  ■ 

QF 

®F 

©FU{m} 

</?3  : 

©FUfm),  QFU{m] 

VA  ■ 

®F,  ©FUfm} 

QF 

©FU{m} 
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For  instance,  the  rule  tp 4  can  take  the  form: 

(B{IsCar),  Q{IsCar,IsRed} 

(B{IsCar  ,IsRed} 

which  says  that  if  there  are  “cars”  and  there  are  no  “non-red  cars”  then  there  are  “red 
cars.” 

We  remark  that  although  different  sets  of  description  sets  can  be  considered,  the  same 
set  of  inference  rules  $  is  employed.  When  defining  a  formal  system  Hi,  the  set  D,  is 
treated  as  a  set  of  (proper)  axioms,  and  the  set  of  descriptions  that  follow  from  Di  using  the 
inference  rules  <E>  is  called  a  theory,  and  is  denoted  by  Tj,  i.e.,  Ti  =  Cn $(£)*)  (the  closure 
of  Di  under  $  =  {<£>1, 1P2,  P3,  <£*4}  or  simply  Cn  (Di).  Hence,  a  description  set  Di  C  D 
is  a  theory  if  Di  =  Cn(.Dj).  A  theory  Tj  is  consistent  if  there  is  no  F  6  F  such  that 
Ti  D  {©F,  ©F}.  We  say  that  a  description  set  Di  is  consistent  if  the  theory  Tj  =  Cn(D,) 
is.  Given  a  theory  Tj  there  is  a  minimal  subset  Aj  of  Tj  such  that  Cn(Aj)  =  Tj :the  set 
Aj  is  called  a  minimal  unique  axiom  set ,  or  a  generator  of  Ti,  and  we  write  Aj  =  gen(Tj). 

An  example  of  a  description  set  Di,  its  theory  Ti  =  Cn(Di),  and  the  generator  Aj  = 
gen  (Tj)  of  the  theory  is  given  below. 

A  =  {  ©{Pl},©{Pl,P2,P3},©{Pl,P2,P3}} 

Ti  =  {  ®{pi,P2},  ffi{Pl},©{P2},©{},e{Pl,P2}, 

©{Pl,P2,P3},  0{pl,P2,m}} 

Aj  =  {  ®  {pi  1 P2}  1  ©  {pi  >  P2  }  } 

We  limit  ourselves  to  consistent  theories :  the  set  of  all  consistent  theories  (over  a  fixed 
M )  is  denoted  by  T.  That  is, 

T  =  {Tj  C  R  |  1  ‘i  is  a  consistent  theory } 

An  obvious  choice  for  an  information  ordering  relation  <  on  consistent  theories  is  the 
relation  of  set  inclusion — a  bigger  theory  says  more  about  the  context.  If  T\,  T2  £  T  then 

Ti  <  T2  iff  T\  C  T2. 

This  turns  T  into  a  partially  ordered  set,  or  poset  (T,  <).  An  empty  set  0  of  descriptions 
is  denoted  by  0.  Clearly,  0  is  a  consistent  theory,  so  0  £  T.  Maximal  elements  of  T  are 
total  theories,  and  are  denoted  by  T^. 

Form  the  set  Tx  =  TU{1},  where  1  is  required  to  satisfy  Tj  <  1,  for  any  Tj  £  T.  Then 
we  have  the  following, 

Proposition  1  (T1?<)  is  a  lattice. 

Proof:  It  is  a  poset:  the  relation  <  is  reflexive,  antisymmetric  and  transitive,  because  C 
is.  Supremum  V  and  infimum  A  are  given  by 

T  VT  =1  Cn(TiuT2)>  if  Ti  \/ T2  is  consistent 
1  2  I  1  if  T\  V  T2  is  inconsistent 

Ti  A  T2  =  Ti  n  T2 

The  theory  1  can  be  seen  as  an  element  employed  to  shift  T  to  obtain  ,  but  one  can 
also  think  of  1  as  representing  inconsistent  theories  □. 
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3.3  Contexts  and  theories 

Recall  that  (K,  <)  and  (T,  <)  are  partially  ordered  sets.  When  relating  contexts  to 
theories  we  define  mappings  between  them,  consider  whether  the  ordering  is  preserved, 
and  comment  on  soundness  and  completeness. 

Define  a  mapping  r :  K  — >  T  as  follows.  If  K{  G  K  then  r(K,)  =  TKi  =  {D  E  D  \ 
K{  |=  D}.  Referring  back  to  Section  3.1,  where  theories  of  contexts  were  defined,  the 
mapping  r  maps  contexts  to  their  theories.  We  easily  obtain  the  following  result,  stating 
that  theories  of  contexts  are  indeed  consistent  theories. 

Proposition  2  Let  Ki  G  K.  Then  TKi  =  r(RTj)  G  T. 

Proof  The  set  of  formulae  valid  in  Ki  is  closed  under  <3>,  because  any  syntactic  in¬ 
ferences  are  semantically  valid  -  they  preserve  validity  -  hence,  valid  formulae  of  K{  form 
a  theory.  The  theory  is  consistent,  because  it  is  impossible  for  a  context  to  have  both  ®F 
and  QF  valid  □. 

An  example  showing  contexts  of  Figure  2  mapped  to  theories  is  shown  in  Figure  3. 


Figure  3:  Contexts,  theories  and  r  mapping 


The  right  hand  side  of  Figure  3  shows  the  lattice  of  all  consistent  theories,  for  the  case 
|P|  =  1.  As  convention  the  empty  context — refer  to  Figure  2 — is  mapped  to  a  theory 
that  contains  all  descriptions  of  the  form  ©F,  but  none  of  the  form  ©F — two  theories 
covered  by  it  (immediately  below  it)  are  not  theories  of  any  contexts,  more  precisely,  they 
are  {©{pi}}  and  {©{pi}},  and  indeed,  they  provide  some  information  about  the  context, 
without  specifying  whether  or  not  the  context  is  empty!  Thus,  the  reverse  mapping,  from 
theories  to  contexts  is  more  problematic — in  fact  we  define  a  mapping  from  theories  to 
sets  of  contexts. 

Define  a  mapping  k:  T  — *  'P(K)  as  follows.  If  T;  G  T  then  re(Tj)  is  given  by  re(Tj)  = 
{K  G  K  |  Tk  >  T{},  we  use  /Cx.  to  denote  «(Tj).  Further,  if  D{  C  D  is  consistent, 
and  hence  Cn(Dl)  =  Tf  G  T  then  we  can  extend  the  mapping  K  to  all  of  D{  by  defining 

k(A)  =  «(Cn(A))  =  k(Ti) 

The  set  of  total  models  for  Tj  is  denoted  by  MOD(Tj)  and  is  given  by  MOD(T,)  =  kJ 
=  {K  G  |  Tk  G  tJ},  where  tJ  =  {T  G  |  T  >  Tj}.  The  set  of  minimal  partial  models 
for  Tj  is  denoted  by  mod(Tj),  or  /CT.  and  is  given  by  mod(Tj)  =  «(Tj)  =  {K  G  K  I  Tk 


15 


DSTO-RR-0118 


>  Ti  and  K  is  < -minimal},  and  it  is  referred  to  as  a  k- model  of  Tt.  We  say  that  D  is 
valid  in  7Cr.,  denoted  by  KT.  f=  D,  if  D  is  valid  in  every  element  of  KT. . 

Regarding  the  information  ordering,  we  easily  obtain  the  following.  Let  T\  =  t(Ki),T2 
t(K2)  €  T.  Then  we  have  that  if  K\  <  K2  then  T\  <  T2.  Indeed,  getting  additional 
information  about  the  same  context  does  not  invalidate  the  descriptions  that  are  already 
valid — this  is  the  result  of  our  definition  of  validity.  One  can  easily  notice  that  <  cannot 
be  replaced  by  its  strict  version  <,  as  there  are  contexts  such  that  one  is  strictly  above  the 
other,  but  both  have  the  same  theory:  for  instance,  with  respect  to  Figures  2  and  3,  note 
that  the  only  context  of  Figure  2  that  has  three  objects  and  the  context  above  it  have  the 
same  theory. 

The  above  considerations  allow  us  to  state  a  soundness  and  completeness  theorem. 

Proposition  3  Let  be  a  formal  system  with  axioms  Di,  let  be  a  K-model  of  Di, 
and  let  D  E  D  and  Di  C  Di.  Then: 

Kt  \=  D  iff  %\~D 

Proof  (Sketch)  Soundness  is  immediate — if  Di  is  a  set  of  axioms  of  "Hi  and  %  D  then 
it  is  sufficient  to  notice  that  the  semantic  equivalent  of  the  syntactic  proof  can  be  carried 
out  in  every  context  of  TLi  — hence,  D  is  valid  in  TLi .  Completeness  is  more  complicated, 
and  employs  a  procedure  for  generating  the  K-model  for  Di  □. 

In  the  next  section  we  limit  ourselves  to  theories,  i.e.,  we  stay  on  the  syntactic  side  of 
the  formalism.  Every  theory  however  has  its  K-model,  a  set  of  minimal  contexts  in  which 
the  theory  is  valid. 


3.4  Multiple  agents 

Let  S  be  a  set  of  agents  and  let  {Ds}seS  be  a  set  of  description  sets  provided  by  the 
agents.  Two  agents  might  provide  the  same  description  set,  and  even  if  their  description 
sets  differ  they  might  produce  the  same  theory.  Let  1  be  the  set  of  believed  theories  of  the 
agents — certainly,  ECT.  Assume  believed  theories  are  nonempty  and  consistent  (agents 
are  assumed  to  be  consistent),  so  B  Pi  {0, 1}  =  0.  We  define  C  =  C1a,v(®)j  where  A  and  V 
are  the  operations  already  defined,  Section  3.2.  Further,  we  define  C+  =  C  U  {0, 1},  and 
so  forming  C+  simply  accounts  to  adding — unless  they  are  already  there — a  bottom  0  and 
a  top  element  1  to  C  unless  they  are  already  there.  It  follows  that  C  and  C+  are  lattices , 
because  they  are  subsets  of  T  closed  under  A  and  V. 

Consider  an  example.  Let  1  =  {Bi,B2},  where  B\  —  Cn({@{pi,p2}})  and  B2  = 
Cn({©{p2})  ®{PiiP2})-  We  get  B\f\B2  =  C3  —  Cn({©{pi}})  and  B\\/B2  =  1  the  theo¬ 
ries  B\,B2  have  a  nonempty  meet  (intersection),  but  they  cannot  be  joined  consistently — 
see  Figure  4(a).  The  closure  C  of  B,  i.e.,  C  =  C1a,v(®)  Is  the  set  {Bi,  B2,  C3, 1},  but  to 
include  both  1  and  0  in  the  picture  we  consider  C+  =  CU{0,1}. 

Given  that  C+  is  a  lattice,  one  might  ask  whether  it  is  a  concept  lattice  in  the  sense 
defined  by  FCA.  We  omit  details  and  limit  ourselves  to  the  example  of  Figure  4.  In  FCA, 
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Figure  Multiple  theories 


concepts  are  certain  pairs  ( extent ,  intent),  where  a  concept’s  extent  is  a  set  of  objects,  and 
its  intent  is  a  set  of  attributes.  Further,  concepts  are  ordered  by  a  subconcept/superconcept 
relation  <,  and  moving  up  in  the  lattice  of  concepts  makes  the  concept’s  extent  (set  of 
objects)  bigger,  and  its  intent  (set  of  attributes)  smaller.  Given  our  lattice  of  theories 
like  that  of  Figure  4,  moving  up  corresponds  to  expanding  the  set  of  theorems:  hence, 
theorems,  or  descriptions/provable  sentences  should  be  treated  as  objects,  in  forming 
extents  of  theories  (concepts).  It  is  appropriate  to  consider  only  those  descriptions  that 
are  axioms  of  some  theories  in  C.  In  the  labelled  line  diagram:  see  Figure  4(b).  We  then 
place  descriptions  in  such  a  way  that  they  appear  at  or  below  the  node  corresponding  to 
the  theory,  e.g.,  in  Figure  4  the  theory  B 2  has  the  descriptions  D2 ,  D3  and  D4,  and  they 
can  be  found  by  traversing  the  lattice  “down”  from  the  theory’s  node.  Finding  concepts’ 
intents  is  more  complicated,  but  the  idea  is  simple,  if  you  move  up  from  theory  to  theory, 
the  set  of  descriptions  gets  bigger,  but  “truthfulness”  of  the  theories  decreases,  and  hence 
we  should  take  as  concepts’  intents,  the  sets  of  “models”  of  the  theories.  We  first  look  at 
Ginsberg’s  world-based  bilattices  [Gin88]. 

Let  the  set  of  believed  theories  1  be  seen  as  a  set  of  worlds.  We  can  use  the  bilattice 
approach  to  associate  truth-values  with  descriptions.  The  set  of  truth-values  F  is  given 
by  the  power  set  of  B,  T  =  'P(B)  x  'P(B)  i.e.,  a  truth  value  is  a  pair  of  sets  of  worlds.  A 
truth-valuation  function  g  :  D  — >  T  is  given  by  g(D)  =  (Up,  Vd),  where  Up  is  a  set  of 
worlds  where  D  is  true,  and  Vd  where  it  is  false.  In  our  case  it  is  appropriate  to  define  U o 
and  Vd  as  follows.  Given  D  G  D,  let  To  =  Cn({T>})  which  is  the  smallest  theory  that 
contains  D. 

Ud  —  {Bi  €  B  |  Bi  >  T d} 
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Vd  =  {Bi  6  B  |  Bi  V  Td  =  1}. 

Given  the  example  of  Figure  4,  the  truth  values  for  the  descriptions  are  presented  in 
Table  3.  Figure  4(c)  shows  the  bilattice-based  truth  values,  together  with  the  bilattice 
orderings  t  (truth-ordering  on  truth-values)  and  k  (information  ordering).  In  Figure  4(d), 
the  truth  values  are  placed  next  to  the  corresponding  descriptions. 


theory 

theory’s  axioms 

axioms’  truth- value 
g(D)  =  (i UD ,  VD) 

Bi 

D\  =  ®{pi,P2> 

«Bl).  {S2() 

b2 

D2  =  ©{P2} 

Ds  =  ®{pi,p2} 

({S2},  {B,» 
({B2},  0) 

c3 

£>4  =  ©{Pi} 

{{BuBzh  0) 

Table  3:  Descriptions  and  their  truth-values 


One  can  note  that  a  single  theory  can  contain  several  descriptions  with  different  truth 
values.  If  this  happens,  then  one  can  separate  such  descriptions  by  presenting  a  theory 
as  a  join  of  its  two  subtheories  (a  small  version  of  such  a  modified  lattice  is  included 
in  Figure  4(d)).  However,  what  we  need  is  truth- values  on  theories,  rather  than  single 
descriptions.  Modify  the  truth  valuation  function  g,  so  that  it  takes  theories  from  C  as  its 
arguments,  g  :  C  — »  T,  and  let  it  be  given  by  g(C)  =  (U(j,V(j),  where  Uq,  the  set  of 
worlds  where  C  is  true ,  and  V(j  where  the  set  of  worlds  C  is  is  false  are  defined  to  be, 

uc  =  {Bi  e  B  I  Bi  >  C } 

Vc  =  {Bi  <=  B  |  Bi  V  C  =  1} 

Note  that  a  theory  is  at  most  as  true  and  at  least  as  false  as  its  descriptions  are.  The 
truth  values  of  the  theories  of  C+  are  presented  in  Table  4 — trivially,  the  empty  theory  0 
is  true  in  every  believed  theory,  and  false  in  none,  and  the  reverse  applies  to  1.  (©1  and 
©1  are  “axioms”  of  X). 


theory’s 

truth-value 

concept’s 

extent 

concept’s 

intent 

Bi 

({Bi},  {J32}) 

{£>i,£4} 

{iio} 

b2 

({B2},  {Bi}) 

{D2,Dz,Dt i} 

{ioi} 

Cz 

({BuB2},  0) 

{D,} 

{jwJoujoo} 

0 

({BuB2},  0) 

0 

{jioJoujoo} 

1 

(0,  {BUB2}) 

{Di,D2,Dz, 
D4,  ©1,  ©1} 

0 

Table  4 •'  Theories  as  concepts 


The  problem  is  that  we  must  not  be  satisfied  with  truth- values  of  theories  so  obtained. 
Indeed,  if  we  associate  a  propositional  symbol  (3i  with  a  statement  “the  theory  (under 
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consideration)  is  true  in  B"  (i.e.,  it  is  below  Bp,  then  we  would,  for  example,  associate 
a  sentence  Pi  V  /32  with  C 3.  Propositional  models  over  {Pl}l  are  functions  from  {Pi}t  to 
{true,  false},  so  j  is  a  model  if  j :  {Pi}i  — >  {true,  false},  where  we  use  the  convention  that, 
for  example,  joi  denotes  a  model  which  satisfies  j(/3\)  =  false  and  j{p 2)  =  true.  Then,  we 
would  get  {jn,  jitbjoi}  as  a  set  of  models  associated  with  C 3:  however  no  theory  can  be 
true  in  both  B\  and  B2  (because  they  contradict  each  other),  so  the  model  jn  needs  to 
be  excluded.  In  addition,  it  is  not  obvious  whether  joo  should  be  excluded:  maybe  it  is 
possible  that  both  B\  and  B2  are  “false,”  but  C3  =  B\  A  B2  nevertheless  is  “true”? 

We  propose  a  different  method  of  obtaining  models  for  theories.  The  reason  that 
bilattice-based  results  are  unsatisfactory  is  that  world-based  bilattices  treat  worlds  as 
indistinguishable  (see  [Gin88],  Sections  4  and  7).  Our  worlds  (theories),  however  are 
structured,  and  in  the  process  of  deriving  models  for  theories  we  should  make  use  of  this 
structure. 

Let  T?  be  a  set  of  total  theories,  i.e.,  T?  is  a  set  of  <-maximal  elements  of  T.  We  first 
propose  how  to  find  models  for  total  theories,  and  then  extend  this  to  all  theories.  Consid¬ 
ering  our  example  of  Figure  4(a),  the  theories  B\,  B2,  C 3  and  0  and  their  corresponding 
total  theories,  i.e.,  total  theories  above  them,  are  presented  in  Figure  5. 


Trj  t| 


Let  e  T?  be  a  total  theory.  Given  a  believed  theory  Bi  G  B,  either  is  true  in 
Bi — i.e.,  T ^  >  Bi — or  T ^  is  false  in  Bi — i.e.,  T ^  V  J3j  =  1;  note  that  no  other  case  is 
possible,  as  T ^  is  total.  Hence,  j  is  a  model  for  T ^  if  the  truth  values  j  assigns  to  elements 
of  {Pi}  “agree”  with  the  truthfulness  of  in  the  elements  of  {Bp,.  In  other  words,  j  is 
a  model  for  if  j(Pp  =  true,  whenever  >  B,  (and  of  course,  false  otherwise).  We 
can  now  extend  this  notion  of  a  model  for  a  theory  to  other  theories.  We  say  that  j  is  a 
model  for  a  theory  C  iff  there  is  a  total  theory  above  C  such  that  j  is  a  model  for 
T'.  Figure  5  can  be  employed  to  find  ji-models  for  B\,  B2,  C 3  and  0.  The  results  are 
included  in  Table  4. 

Looking  at  Figure  5,  it  is  clear  how  to  assign  a  numeric  measure  to  theories.  If  W\ 
is  a  weight  we  associate  with  B\,  then  B\  would  determine  a  measure  on  total  theories, 
in  such  a  way  that  the  ratio  between  the  measure  of  a  theory  in  t{  to  the  measure  of  a 
theory  in  T”*"  \t{  is  rui/(l  —  tui),  and  the  sum  of  measures  on  total  theories  is  1.  Similarly, 
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B 2  would  determine  “its”  measure,  and  (the  two  would  determine  a  resulting  measure 
via  some  quasi-probablistic  method  for  numerical  certainty  combination).  However,  the 
weights  x&i  are  usually  not  known.  Although  some  restriction  on  them  can  be  stipulated 
(e.g.,  average  weight  is  greater  than  1/2),  or  derived:  but  then,  a  maximum  entropy 
principle  can  be  used  to  determine  the  weights.  Hence  we  get  a  measure  on  total  theories, 
and  this  determines  a  measure  on  all  theories.  However,  a  set  of  total  theories  is  large, 
I'jd'l  =  22“,  where  a  =  |P|,  so  such  a  measure  can  be  difficult  to  compute:  but  one  can 
derive  a  measure  on  j-models,  rather  than  on  total  theories. 

The  above  considerations  allow  us  to  say  that  we  can  derive  a  preference  relation 
on  theories,  given  just  the  set  1  of  believed  theories;  preference  is  based  on  truthfulness 
and  informational  value  of  theories,  and  thus  is  a  result  of  how  theories  agree/reject  each 
other.  A  method  of  deriving  a  numeric  measure  is  sketched  which  gives  a  numerical,  rather 
than  order-theoretic  preference.  It  is  clear  that  deriving  preference  relations  on  objects 
of  interest.  In  this  case  on  theories,  crucial  for  deciding  which  information  to  accept,  or, 
more  generally,  how  to  decide  what  to  prefer. 
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4  INTELLIGENCE  ANALYSIS  AND 
CONCEPTUAL  REASONING 

Intelligence  analysts  are  faced  with  the  problem  of  describing  the  current,  or  some 
predicted  future  state  of  the  world.  To  reduce  uncertainty,  they  collect,  analyse,  combine 
and  fuse  information.  Information  may  come  from  a  variety  of  sources  and  agencies. 
The  intelligence  analyst  is  normally  required  to  make  an  assessment,  and  provide  some 
prediction,  when  only  partial  information  is  held.  The  various  sources  and  agencies  are 
commonly  assessed  as  being  of  varying  reliabilities,  their  information  of  various  (believed) 
accuracies1. 

The  information  provided  may  be  contradictory,  confirmatory,  or  neither.  It  may 
also  be  either  “positive”  or  “negative”  information,  ie,  “something  was  observed”,  or 
“something  was  not  observed” .  The  conceptual  reasoning  framework  developed  by  Nowak 
[Now97],  and  described  earlier  in  this  report,  presents  the  potential  to  address  these  prob¬ 
lems  with  the  analysis  of  intelligence  information:  to  decide  what  particular  subsets  (in¬ 
cluding  all)  agents  agree  on,  what  they  disagree  on,  and  on  what  they  reserve  judgement. 
The  agents  could  be  simple  sensors,  Intelligence  Agencies  with  significant  processing  ca¬ 
pability  and  sources  of  their  own,  or  anything  in  between.  There  may  be  a  mix  of  types, 
and  there  may  be  a  “hierarchy”  of  sources  and  agencies,  in  that  some  of  the  agencies  may 
have  access  to  some  or  all  of  the  information  available  to  some  or  all  other  agencies,  and 
may  have  formed  their  beliefs  after  taking  these  other  views  and  beliefs  into  account. 

The  case  of  a  single  intelligent  agent  reasoning  with  the  inputs  of  a  number  of  simple 
sensor  sources  has  been  dealt  with  extensively  in  the  literature  (on  data  fusion),  and  there 
are  a  number  of  possible  approaches.  The  question  of  whether  these  approaches  can  scale 
to  more  complex  situations  remains,  we  believe,  open. 

We  choose  to  illustrate  the  application  of  Conceptual  Reasoning  to  the  domain  of 
Intelligence  Analysis  with  a  simple  example  drawn  from  the  multi-sensor  fusion  problem 
of  aircraft  identification.  It  is  stressed  that  we  are  not  advocating  Conceptual  Reasoning 
as  the  best  approach  to  this  problem;  we  are  using  it  as  a  simple  example  for  illustrative 
purposes. 


4.1  Example:  Multi-sensor  Fusion 

Suppose  we  have  three  information  sources  (say,  sensors),  si, 52,^3  which  can  report 
on  the  following  attributes  of  observed  objects  (say,  aircraft): 

pi  =  large? 

P2  =  radar? 

Pi  =  fast? 

Pi  =  high? 


1It  is  common  in  Intelligence  circles  to  grade  sources  in  terms  of  their  reliability,  from  A  to  F,  and 
information  in  terms  of  its  (believed)  accuracy,  from  1  to  6.  This  is  known  as  the  Admiralty  System. 
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Our  three  sensors  report  as  follows: 


si  -4  Di  -4  At  =  gen(Bi)  =  {©{pi,p2}} 

s2  t  D2  t  A2  =  gen{B2)  =  {©{pi,P3}} 

S3  t  t  A3  =  gen(B3)  =  {©{pi},  ©{pl,p4}} 

Read  as  “source  n  produces  a  description  set  of  observations,  from  which  can  be  derived 
a  minimal  set  of  logical  statements  that  fully  generate  the  belief  that  source  n  holds,  and 
this  is  . 

Prom  these  beliefs,  we  can  create  a  lattice  by  closure  under  meet  and  join  (the  detailed 
labelling  of  the  lattice  is  omitted  for  clarity). 


Bi 


6 

Figure  6:  The  lattice  of  beliefs  for  agents  Bi,B2  and  Bz- 

We  can  see  a  number  of  things  about  the  beliefs  B\,  B2 ,  and  Bz ,  e.g.,  there  is  a  possible 
world  (or  a  number  of  them)  in  which  the  beliefs  B\  and  B2  are  compatible  (they  agree 
on  ©{pi}),  but  the  beliefs  B\  and  B2  contradict  B3  (who  believes  ©{pi}).  We  can  see 
that  B\  and  B2  agree  on  something  (©{pi}),  but  that  {B\  and  B2}  and  Bz  agree  only 
that  the  world  is  non-empty. 

There  are,  in  principle,  a  number  of  states  that  the  world  could  actually  be  in2.  If 
we  had  total,  accurate,  information,  we  would  know  which  of  these  states  the  world  was 
actually  in.  Our  problem  is  to  make  some  form  of  statement,  or  prediction,  in  light  of 
our  partial,  perhaps  contradictory,  information.  If  we  have  no  information  (observations), 
we  can  only  make  the  statement  that  anything  is  possible  (conditioned,  perhaps,  by  some 
likelihoods  derived  from  past  beliefs  or  observations). 

As  information  is  collected,  we  are  able  to  reduce  the  size  of  the  set  of  possible  states. 
We  can  use  the  lattice  to  guide  our  information  collection,  as  well  as  to  reason  with  the 
information  that  we  have. 

2It  is  assumed  that  states  are  described  at  such  a  level  of  detail  as  to  make  them  mutually  exclusive, 
and,  of  course,  exhaustive.  If  there  are  n  attributes  to  distinguish  objects  in  the  world,  there  are  22  such 
states,  as  stated  earlier 


22 


DSTO-RR-0118 


It  is  obviously  necessary  to  address  contradictions  as  a  matter  of  priority.  We  could 
collect  further  information,  but,  once  we  have  a  contradiction,  we  will  continue  to  have  it 
until  either: 

1.  we  discount  the  beliefs  of  one  or  more  agents  entirely,  so  that  contradiction  is  re¬ 
moved.  We  might  choose  this  course  if  we  believe  one  or  more  agents  to  be  unreliable, 
or  if  we  believe  in  the  possibility  of  deliberate  deception.  In  this  way,  we  assign  pref¬ 
erence  to  the  beliefs  of  some  agents  over  others,  where  contradictions  occur. 

2.  we  retract  some  minimal  set  of  beliefs  from  one  or  more  agents  in  order  to  remove 
contradiction,  but  leave  the  remainder  of  the  agents’  beliefs  intact.  This  would  seem 
the  more  appropriate  action  when  we  assign  no  preference  over  agents,  but  assign 
preference  over  the  information  itself,  i.e.,  when  we  hold  no  intrinsic  belief  about 
the  reliability  ordering  of  the  respective  agents,  but  we  do  hold  some  intrinsic  belief 
about  the  accuracy  of  the  information  reported  by  some  agents. 


Either  way,  after  the  retraction/removal,  we  reconstruct  the  lattice  and  proceed. 

Continuing  our  example,  case  1  above  results  in  the  lattice  at  Figure  7,  and  case  2 
above  results  in  Figure  8. 


B 


1 


Figure  7:  Removing  Contradiction  by  eliminating  f?3  influence 


We  are  now  dealing  with  lattices  showing  no  contradiction  between  agent  beliefs.  We 
shall  now  address  the  matter  of  confirmation.  In  our  example,  all  agents  agree  the  world 
is  non-empty,  so  it  seems  reasonable  to  accept  this.  B\  and  B2  agree  that  there  exists 
an  object  (or,  at  least  one  such  object)  with  attribute  pi,  so  we  might  accept  this  as 
confirmation  of  this  “fact”  (assuming  that  si  and  S2  are  independent  sources).  Other  than 
these,  there  is  no  confirmation,  by  any  agent,  of  any  other  agents’  beliefs.  This  touches 
on  the  matter  of  precision  versus  accuracy,  or  the  granularity  of  classification.  We  make 
a  trade  off  between  being  more  specific,  or  precise,  and  being  accurate,  or  correct.  In  this 
last  example,  we  can  say  with  confidence  that  the  world  is  non-empty  —  all  agents  agree 
on  this.  We  can  say  with  less  confidence  that  there  is  an  object  with  attribute  p\  (two 
agents  agree  on  this),  with  still  less  confidence  that  there  is  an  object  with  attribute  P4, 
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Figure  8:  Removing  Contradiction  by  retracting  ©{pi}  from  B3. 

an  object  with  the  attributes  p\  and  p2,  and  an  object  with  the  attributes  p\  and  P3  (only 
one  agent  believes  each  of  these). 

There  are,  of  course,  a  number  of  possible  states  (at  least  one)  of  the  world  in  which  all 
beliefs  of  all  of  the  agents  are  true.  We  have  ensured  this  by  removing  the  contradictions 
between  their  beliefs.  Using  a  lattice  approach,  we  are  able  to  examine  what  theories 
are  possible  (or  states  of  the  world  possible),  based  on  the  beliefs  of  any  single  agent,  any 
combination  of  agents,  or  any  shared  (i.e.,  confirmed)  beliefs  of  any  combination  of  agents. 

We  do  this  by  noting  that  the  lattice  we  have  formed  is  a  sub-lattice  of  the  total  lattice 
of  theories  in  this  domain.  If  we  proceed  “upwards”  in  the  total  lattice,  from  any  point 
marked  by  our  sub-lattice,  we  will  find,  at  the  penultimate  level,  all  of  the  possible  states, 
given  the  beliefs  of  the  starting  point. 

This  is  a  potentially  powerful  tool,  and  it  should  be  noted  that  this  approach  generates 
a.strict  superset  of  the  union  of  the  possible  states  generated  from  each  individual  agents’ 
beliefs. 

This  point  is  illustrated  using  the  example  given  earlier  in  Section  3.4.  The  believed 
theories  and  their  axioms  appear  in  table  3.  Figure  9  shows  the  sub-lattice  containing  the 
theories.  The  top  row  of  this  figure  shows  all  possible  states  of  the  world  ( K{ ).  The  states 
consistent  with  B\  are  (JS4,  E5,  Ee,  E7,  Eu,  Eu,  E 14,  £?i5).  The  states  consistent 
with  i?2  are  (Es,  Eg).  The  states  consistent  with  both  B\  and  B2,  i.e.  (C 3  —  where 
they  both  confirm  each  other,  is  a  superset  of  the  union  of  the  states  consistent  with  each 
theory  —  it  also  contains  E 10)  and  E\\). 


4.2  Incorporation  of  Database  Knowledge 

Let  us  suppose  that  we  have  a  database  of  knowledge  about  the  possible  objects  in  the 
world. 

We  could  use  this  database  to  “mark”  the  possible  states  of  the  world  generated  in 
the  above  approach,  as  either  “remaining  possible”,  or  “impossible”.  Recall  there  are 
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Figure  9:  Total  theories  above  B\,  B2,  C 3  and  0 


Objects 

Attributes 

747 

+ 

— 

+  ... 

DC8 

+ 

- 

+  ... 

F16 

— 

+ 

+  ... 

F18 

— 

+ 

+  ... 

Cessna 

— 

— 

- 

A10 

+ 

+ 

- 

B52 

+ 

+ 

+  ... 

Table  5:  Database  of  Aircraft  Attributes 


22"  possible  states,  where  n  is  the  number  of  attributes.  Proceeding  with  the  example 
illustrated  in  fig  7  above  (where  we  chose  to  remove  a  contradiction  by  entirely  discounting 
the  beliefs  of  source  S3),  we  find  that  there  are  22  =  256  possible  states!  With  the  database 
knowledge  above,  all  but  64  of  these  states  are  marked  “impossible”. 

With  the  aid  of  suitable  notation,  the  states  above  each  of  the  beliefs  in  the  lattice  can 
be  stated.  It  is  possible  to  do  this  by  hand  for  our  simple  example  (see  the  appendix),  but 
software  support  would  be  needed  for  it  to  be  practical  for  expected  real-world  problems. 
This  software  has  not  been  developed  and  could  be  the  subject  of  a  continuation  of  this 
research  agreement. 

Another  approach  to  the  incorporation  of  database  knowledge  is  to  treat  the  database 
knowledge  as  another  “source”,  and  to  form  a  lattice  of  the  sources’  beliefs,  and  the 
database.  The  database’s  belief,  from  table  5,  would  be:  {©{pi,P2,P3},  ®{pT,P2,P'i}, 
®{Pi,P2,P3},  and  so  on  —  remembering,  of  course,  to  include  0  statements  for  every 
combination  of  attributes  not  found  in  the  database. 
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The  theories  “above”  any  particular  combination  of  beliefs  could  then  be  found.  Again, 
this  is  impractical,  for  any  serious  real  world  problem,  without  the  development  of  software 
specific  to  this  purpose,  and,  again,  such  software  has  not  been  developed  for  this  study. 

Despite  the  limited  scope  of  our  study  to  include  only  a  discussion  of  the  theory  of 
conceptual  reasoning  and  a  simple  example  from  the  multi-sensor  domain,  it  is  natural  to 
make  some  comments  about  the  implementation  of  the  framework  in  software.  A  similar 
study  from  the  ESM  domain  [HM86,  GS87],  encounters  a  similar  multi-agent  problem. 
In  that  task  an  Assumption-based  Truth  Maintenance  System  (ATMS)  [dK86]  was  used 
to  track  the  interactions  of  beliefs.  Such  a  system  would  no  doubt  be  employed  for  any 
implementation  of  a  conceptual  reasoning  framework.  Our  claim  in  this  report,  however, 
is  that  we  are  setting  the  scene  by  developing  the  appropriate  theory  that  underpins  the 
approach. 
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5  CONCLUSION 

In  Section  1  we  introduced  the  scope  of  the  study  and  discussed  how,  in  general  terms, 
the  techniques  might  be  applied  to  the  defence  domain.  We  then  presented  the  preliminary 
theory  of  formal  concept  analysis  in  Section  2.1.  Formal  concept  analysis  not  only  gives 
the  foundations  for  conceptual  reasoning  but  also  suggests  applications  in  the  defence 
intelligence  domain  in  its  own  right. 

In  Section  3,  we  presented  the  theoretical  foundations  of  Conceptual  Reasoning.  We 
proposed  partial  abstract  contexts  as  partial  models  of  worlds  consisting  of  objects  having 
attributes.  Furthermore,  we  defined  formal  systems  which  allow  us  to  find  sentences 
(descriptions)  that  follow  from  a  given  set,  and  we  related  the  two,  taking  into  account 
that  the  set  of  contexts  K  and  the  set  of  theories  T  are  sets  equipped  with  their  information 
orderings. 

We  then  considered  the  multiple  agent  case.  Given  a  set  of  agents,  the  set  of  their 
believed  theories  is  B,  and  the  resulting  lattice  is  C,  or  C+,  if  we  include  an  empty  theory  0 
and  an  “inconsistent  theory”  1.  We  have  shown  how  one  should  interpret  such  structures, 
and  suggested  how  preference  relations  on  theories  can  be  derived. 

As  an  illustration  of  the  formalism,  in  Section  4  we  showed  how  conceptual  reasoning 
can  be  applied  in  the  multi-sensor  fusion  domain.  The  complete  working  of  the  example  is 
provided  as  an  appendix  to  this  report.  We  recommend  that  any  further  implementation 
of  the  framework  for  real-time  fusion  and  recognition  tasks  be  based  on  assumption-based 
truth  maintenance  or  similar  technology. 
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Appendix 


The  following  section  demonstrates  how  the  working  of  the  example  presented  in  Sec¬ 
tion  4  was  derived. 


Firstly,  the  total  objects  over  the  agencies  are  computed. 


total  objects: 


object 

+valid  sentence 

code 

g.000 

+{-pl,-p2,-p3} 

000 

g-002 

+{-pl,-p2,p3> 

002 

g-020 

+{-pl,p2,-p3> 

020 

g-022 

+{-pl,p2,p3> 

022 

g-200 

+{pl,-p2,-p3> 

200 

g-202 

+{pl,-p2,p3> 

202 

g-220 

+{pl,p2,-p3> 

220 

g-222 

+{pl,p2,p3> 

222 

The  total  theories  or  total  contexts,  i.e.,  subsets  of  the  set  of  all  total  objects, 
can  be  identified  with  functions  from  {<7ooo>  ■  •  •  ,9222}  1°  {0, 1},  i.e.  with  subsets 
of  the  set  of  all  total  objects. 


{> 

{g_222> 

tg_220> 

fg_220,g_222> 


tg-000,  ...  ,g.222> 


00000000  1  I  * 

00000001  0  I  *  *  *  * 

00000010  — >  this  represents:  - 

00000011  g  g  g  . . .  g  g 

000  002  020  220  222 


11111111 


B_1  =  Cn({+{pl  ,p2») 
B_2  =  Cn({+{pl,p3») 
C_3  =  B_1  /\  B_2  = 

=  Cn({+{pl») 

C_4  =  B_1  \/  B_2  = 

=  Cn({+{pl,p2>, 
+{pl,p3}}) 


gen(B_l)  =  {+{pl,p2» 
gen(B_2)  =  {+{pl,p3}} 

gen(C_3)  =  {+{pl» 

gen(C_4)  =  {+{pl,p2>, 
+{pl ,p3}} 


BBC 

C 

(i.e 

. ,  above  B_1 ,  B_2 

is  this  total 

theory 

above  the  th: 

12  3 

4  ??? 

{g_222> 

00000001 

?  ?  ? 

? 

{g.220} 

002 

00000010 

?  ?  ? 

? 

{g_220,g_222} 

00000011 

?  ?  ? 

? 

. ** 

above 

B_1 

if 

1  there 

. *  .  * 

above 

B_2 

if 

1  there 

**** 

above 

C_3 

if 

1  there 

above 

C_4 

if 

above  B_1  and  B_2 
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Below  are  total  theories  sorted  by  their  binary  codes: 


the  sign  +  or  -  depending  on 
/  whether  the  given  total  theory 
I  is  above  B_1  (similarly  for  B_2,  C_3,  C_4) 

I 


000 

00000000 

- 

- 

- 

- 

001 

00000001 

+ 

+ 

+ 

+ 

002 

00000010 

+ 

- 

+ 

- 

003 

00000011 

+ 

+ 

+ 

+ 

004 

00000100 

- 

+ 

+ 

- 

005 

00000101 

+ 

+ 

+ 

+ 

006 

00000110 

+ 

+ 

+ 

+ 

007 

00000111 

+ 

+ 

+ 

+ 

008 

00001000 

- 

- 

+ 

- 

009 

00001001 

+ 

+ 

+ 

+ 

010 

00001010 

+ 

- 

+ 

- 

011 

00001011 

+ 

+ 

+ 

+ 

012 

00001100 

- 

+ 

+ 

- 

013 

00001101 

+ 

+ 

+ 

+ 

014 

00001110 

+ 

+ 

+ 

+ 

015 

00001111 

+ 

+ 

+ 

+ 

016 

00010000 

- 

- 

- 

- 

017 

00010001 

+ 

+ 

+ 

+ 

018 

00010010 

+ 

- 

+ 

- 

019 

00010011 

+ 

+ 

+ 

+ 

020 

00010100 

- 

+ 

+ 

- 

021 

00010101 

+ 

+ 

+ 

+ 

022 

00010110 

+ 

+ 

+ 

+ 

023 

00010111 

+ 

+ 

+ 

+ 

024 

00011000 

- 

- 

+ 

- 

025 

00011001 

+ 

+ 

+ 

+ 

026 

00011010 

+ 

- 

+• 

- 

027 

00011011 

+ 

+ 

+ 

+ 

028 

00011100 

- 

+ 

+ 

- 

029 

00011101 

+ 

+ 

+ 

+ 

030 

00011110 

+ 

+ 

+ 

+ 

031 

00011111 

+ 

+ 

+ 

+ 

032 

00100000 

- 

- 

- 

- 

033 

00100001 

+ 

+ 

+ 

+ 

034 

00100010 

+ 

- 

+ 

- 

035 

00100011 

+ 

+ 

+ 

+ 

036 

00100100 

- 

+ 

+ 

- 

037 

00100101 

+ 

+ 

+ 

+ 

038 

00100110 

+ 

+ 

+ 

+ 

039 

00100111 

+ 

+ 

+ 

+ 

040 

00101000 

- 

- 

+ 

- 

041 

00101001 

+ 

+ 

+ 

+ 

042 

00101010 

+ 

- 

+ 

- 

043 

00101011 

+ 

+ 

+ 

+ 

044 

00101100 

- 

+ 

+ 

- 

045 

00101101 

+ 

+ 

+ 

+ 

046 

00101110 

+ 

+ 

+ 

+ 

047 

00101111 

+ 

+ 

+ 

+ 

048 

00110000 

- 

- 

- 

- 

049 

00110001 

+ 

+ 

+ 

32 


DSTO-RR-0118 


050 

00110010 

+ 

- 

+ 

- 

051 

00110011 

+ 

+ 

+ 

+ 

052 

00110100 

- 

+ 

+ 

- 

053 

00110101 

+ 

+ 

+ 

+ 

054 

00110110 

+ 

+ 

+ 

+ 

055 

00110111  ' 

+ 

+ 

+ 

+ 

056 

00111000 

- 

- 

+ 

- 

057 

00111001 

+ 

+ 

+ 

+ 

058 

00111010 

+ 

- 

+ 

- 

059 

00111011 

+ 

+ 

+ 

+ 

060 

00111100 

- 

+ 

+ 

- 

061 

00111101 

+ 

+ 

+ 

+ 

062 

00111110 

+ 

+ 

+ 

+ 

063 

00111111 

+ 

+ 

+ 

+ 

064 

01000000 

- 

- 

- 

- 

065 

01000001 

+ 

+ 

+ 

+ 

066 

01000010 

+ 

- 

+ 

- 

067 

01000011 

+ 

+ 

+ 

+ 

068 

01000100 

- 

+ 

+ 

- 

069 

01000101 

+ 

+ 

+ 

+ 

070 

01000110 

+ 

+ 

+ 

+ 

071 

01000111 

+ 

+ 

+ 

+ 

072 

01001000 

- 

- 

+ 

- 

073 

01001001 

+ 

+ 

+ 

+ 

074 

01001010 

+ 

- 

+ 

- 

075 

01001011 

+ 

+ 

+ 

+ 

076 

01001100 

- 

+ 

+ 

- 

077 

01001101 

+ 

+ 

+ 

+ 

078 

01001110 

+ 

+ 

+ 

+ 

079 

01001111 

+ 

+ 

+ 

+ 

080 

01010000 

- 

- 

- 

- 

081 

01010001 

+ 

+ 

+ 

+ 

082 

01010010 

+ 

- 

+ 

- 

083 

01010011 

+ 

+ 

+ 

+ 

084 

01010100 

- 

+ 

+ 

- 

085 

01010101 

+ 

+ 

+ 

+ 

086 

01010110 

+ 

+ 

+ 

+ 

087 

01010111 

+ 

+ 

+ 

•f 

088 

01011000 

- 

- 

+ 

- 

089 

01011001 

+ 

+ 

+ 

+ 

090 

01011010 

+ 

- 

+ 

- 

091 

01011011 

+ 

+ 

+ 

+ 

092 

01011100 

- 

+ 

+ 

- 

093 

01011101 

+ 

+ 

+ 

+ 

094 

01011110 

+ 

+ 

+ 

+ 

095 

01011111 

+ 

+ 

+ 

+ 

096 

01100000 

- 

- 

- 

- 

097 

01100001 

+ 

+ 

+ 

+ 

098 

01100010 

+ 

- 

+ 

- 

099 

01100011 

+ 

+ 

+ 

+ 

100 

01100100 

- 

+ 

+ 

- 

101 

01100101 

+ 

+ 

+ 

+ 

102 

01100110 

+ 

+ 

+ 

+ 

103 

01100111 

+ 

+ 

+ 

+ 

104 

01101000 

- 

- 

+ 

- 

105 

01101001 

+ 

+ 

+ 

+ 
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106 

01101010 

+ 

- 

+ 

- 

107 

01101011 

+ 

+ 

+ 

+ 

108 

01101100 

- 

+ 

+ 

- 

109 

01101101 

+ 

+ 

+ 

+ 

110 

01101110 

+ 

+ 

+ 

+ 

111 

01101111 

+ 

+ 

+ 

+ 

112 

01110000 

- 

- 

- 

- 

113 

01110001 

+ 

+ 

+ 

+ 

114 

01110010 

+ 

- 

+ 

- 

115 

01110011 

+ 

+ 

+ 

+ 

116 

01110100 

- 

+ 

+ 

- 

117 

01110101 

+ 

+ 

+ 

+ 

118 

01110110 

+ 

+ 

+ 

+ 

119 

01110111 

+ 

+ 

+ 

+ 

120 

01111000 

- 

- 

+ 

- 

121 

01111001 

+ 

+ 

+ 

+ 

122 

01111010 

+ 

- 

+ 

- 

123 

01111011 

+ 

+ 

+ 

+ 

124 

01111100 

- 

+ 

+ 

- 

125 

01111101 

+ 

+ 

+ 

+ 

126 

01111110 

+ 

+ 

+ 

+ 

127 

01111111 

+ 

+ 

+ 

+ 

128 

10000000 

- 

- 

- 

- 

129 

10000001 

+ 

+ 

+ 

+ 

130 

10000010 

+ 

+ 

- 

131 

10000011 

+ 

+ 

+ 

+ 

132 

10000100 

- 

+ 

+ 

- 

133 

10000101 

+ 

+ 

+ 

+ 

134 

10000110 

+ 

+ 

+ 

+ 

135 

10000111 

+ 

+ 

+ 

+ 

136 

10001000 

- 

- 

+ 

- 

137 

10001001 

+ 

+ 

+ 

+ 

138 

10001010 

+ 

- 

+ 

- 

139 

10001011 

+ 

+ 

+ 

+ 

140 

10001100 

- 

+ 

+ 

- 

141 

10001101 

+ 

+ 

+ 

+ 

142 

10001110 

+ 

+ 

+ 

+ 

143 

10001111 

+ 

+ 

+ 

+ 

144 

10010000 

- 

- 

- 

- 

145 

10010001 

+ 

+ 

+ 

+ 

146 

10010010 

+ 

- 

+ 

- 

147 

10010011 

+ 

+ 

+ 

+ 

148 

10010100 

- 

+ 

+ 

- 

149 

10010101 

+ 

+ 

+ 

+ 

150 

10010110 

+ 

+ 

+ 

+ 

151 

10010111 

+ 

+ 

+ 

+ 

152 

10011000 

- 

- 

+ 

- 

153 

10011001 

+ 

+ 

+ 

+ 

154 

10011010 

+ 

- 

+ 

- 

155 

10011011 

+ 

+ 

+ 

+ 

156 

10011100 

- 

+ 

+ 

- 

157 

10011101 

+ 

+ 

+ 

+ 

158 

10011110 

+ 

+ 

+ 

+ 

159 

10011111 

+ 

+ 

+ 

+ 

160 

10100000 

- 

- 

- 

- 

161 

10100001 

+ 

+ 

+ 

+ 
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162 

10100010 

+ 

- 

+ 

- 

163 

10100011 

+ 

+ 

+ 

+ 

164 

10100100 

- 

+ 

+ 

- 

165 

10100101 

+ 

+ 

+ 

+ 

166 

10100110 

+ 

•f 

+ 

+ 

167 

10100111 

+ 

+ 

+ 

+ 

168 

10101000 

- 

- 

+ 

- 

169 

10101001 

+ 

+ 

+ 

+ 

170 

10101010 

+ 

- 

+ 

- 

171 

10101011 

+ 

+ 

+ 

+ 

172 

10101100 

- 

+ 

+ 

- 

173 

10101101 

+ 

+ 

+ 

+ 

174 

10101110 

+ 

+ 

+ 

+ 

175 

10101111 

+ 

+ 

+ 

+ 

176 

10110000 

- 

- 

- 

- 

177 

10110001 

+ 

+ 

+ 

+ 

178 

10110010 

+ 

- 

+ 

- 

179 

10110011 

+ 

+ 

+ 

+ 

180 

10110100 

- 

+ 

+ 

- 

181 

10110101 

+ 

+ 

+ 

+ 

182 

10110110 

+ 

+ 

+ 

+ 

183 

10110111 

+ 

+ 

+ 

+ 

184 

10111000 

- 

- 

+ 

- 

185 

10111001 

+ 

+ 

+ 

+ 

186 

10111010 

+ 

- 

+ 

- 

187 

10111011 

+ 

+ 

+ 

+ 

188 

10111100 

- 

+ 

+ 

- 

189 

10111101 

+ 

+ 

+ 

+ 

190 

10111110 

+ 

+ 

+ 

+ 

191 

10111111 

+ 

+ 

+ 

+ 

192 

11000000 

- 

- 

- 

- 

193 

11000001 

+ 

+ 

+ 

+ 

194 

11000010 

+ 

- 

+ 

- 

195 

11000011 

+ 

+ 

+ 

+ 

196 

11000100 

- 

+ 

+ 

- 

197 

11000101 

+ 

+ 

+ 

+ 

198 

11000110 

+ 

+ 

+ 

+ 

199 

11000111 

+ 

+ 

+ 

+ 

200 

11001000 

- 

- 

+ 

- 

201 

11001001 

+ 

+ 

+ 

+ 

202 

11001010 

+ 

- 

+ 

- 

203 

11001011 

+ 

+ 

+ 

+ 

204 

11001100 

- 

+ 

+ 

- 

205 

11001101 

+ 

+ 

+ 

+ 

206 

11001110 

+ 

+ 

+ 

+ 

207 

11001111 

+ 

+ 

+ 

+ 

208 

11010000 

- 

- 

- 

- 

209 

11010001 

+ 

+ 

+ 

+ 

210 

11010010 

+ 

- 

+ 

- 

211 

11010011 

+ 

+ 

+ 

+ 

212 

11010100 

- 

+ 

+ 

- 

213 

11010101 

+ 

+ 

+ 

+ 

214 

11010110 

+ 

+ 

+ 

+ 

215 

11010111 

+ 

+ 

+ 

+ 

216 

11011000 

- 

- 

+ 

- 

217 

11011001 

+ 

+ 

+ 

+ 
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218 

11011010 

+ 

- 

+ 

- 

219 

11011011 

+ 

+ 

+ 

+ 

220 

11011100 

- 

+ 

+ 

- 

221 

11011101 

+ 

+ 

+ 

+ 

222 

11011110 

+ 

+ 

+ 

+ 

223 

11011111 

+ 

+ 

+ 

+ 

224 

11100000 

- 

- 

- 

- 

225 

11100001 

+ 

+ 

+ 

+ 

226 

11100010 

+ 

- 

+ 

- 

227 

11100011 

+ 

+ 

+ 

+ 

228 

11100100 

- 

+ 

+ 

- 

229 

11100101 

+ 

+ 

+ 

+ 

230 

11100110 

+ 

+ 

+ 

+ 

231 

11100111 

+ 

+ 

+ 

+ 

232 

11101000 

- 

- 

+ 

- 

233 

11101001 

+ 

+ 

+ 

+ 

234 

11101010 

+ 

- 

+ 

- 

235 

11101011 

+ 

+ 

+ 

+ 

236 

11101100 

- 

+ 

+ 

- 

237 

11101101 

+ 

+ 

+ 

+ 

238 

11101110 

+ 

+ 

+ 

+ 

239 

11101111 

+ 

+ 

+ 

+ 

240 

11110000 

- 

- 

- 

- 

241 

11110001 

+ 

+ 

+ 

+ 

242 

11110010 

+ 

- 

+ 

- 

243 

11110011 

+ 

+ 

+ 

+ 

244 

11110100 

- 

+ 

+ 

- 

245 

11110101 

+ 

+ 

+ 

+ 

246 

11110110 

+ 

+ 

+ 

+ 

247 

11110111 

+ 

+ 

+ 

+ 

248 

11111000 

- 

- 

+ 

- 

249 

11111001 

+ 

+ 

+ 

+ 

250 

11111010 

+ 

- 

+ 

- 

251 

11111011 

+ 

+ 

+ 

+ 

252 

11111100 

- 

+ 

+ 

- 

253 

11111101 

+ 

+ 

+ 

+ 

254 

11111110 

+ 

+ 

+ 

+ 

255 

11111111 

+ 

+ 

+ 

+ 

###################################################################### 


Now,  the  same  theories  sorted  by  +/-’s,  to  facilitate  how  many  (and  which) 
theories  are  above  B\,B2,Cz,C±: 


001 

00000001 

+ 

+ 

+ 

+ 

003 

00000011 

+ 

+ 

+ 

+ 

005 

00000101 

+ 

+ 

+ 

+ 

006 

00000110 

+ 

+ 

+ 

+ 

007 

00000111 

+ 

+ 

+ 

+ 

009 

00001001 

+ 

+ 

+ 

+ 

Oil 

00001011 

+ 

+ 

+ 

+ 

013 

00001101 

+ 

+ 

+ 

+ 

014 

00001110 

+ 

+ 

+ 

+ 

015 

00001111 

+ 

+ 

+ 

+ 

017 

00010001 

+ 

+ 

+ 

+ 

019 

00010011 

+ 

+ 

+ 

+ 
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021 

00010101 

+ 

+ 

+ 

+ 

022 

00010110 

+ 

+ 

+ 

+ 

023 

00010111 

+ 

+ 

+ 

+ 

025 

00011001 

+ 

+ 

+ 

+ 

027 

00011011 

+ 

+ 

+ 

+ 

029 

00011101 

+ 

+ 

+ 

+ 

030 

00011110 

+ 

+ 

+ 

+ 

031 

00011111 

+ 

+ 

+ 

+ 

033 

00100001 

+ 

+ 

+ 

+ 

035 

00100011 

+ 

+ 

+ 

+ 

037 

00100101 

+ 

+ 

+ 

+ 

038 

00100110 

+ 

+ 

+ 

+ 

039 

00100111 

+ 

+ 

+ 

+ 

041 

00101001 

+ 

+ 

+ 

+ 

043 

00101011 

+ 

+ 

+ 

+ 

045 

00101101 

+ 

+ 

+ 

+ 

046 

00101110 

+ 

+ 

+ 

+ 

047 

00101111 

+ 

+ 

+ 

+ 

049 

00110001 

+ 

+ 

+ 

+ 

051 

00110011 

+ 

+ 

+ 

+ 

053 

00110101 

+ 

+ 

+ 

+ 

054 

00110110 

+ 

+ 

+ 

+ 

055 

00110111 

+ 

+ 

+ 

+ 

057 

00111001 

+ 

+ 

+ 

+ 

059 

00111011 

+ 

+ 

+ 

+ 

061 

00111101 

+ 

+ 

+ 

+ 

062 

00111110 

+ 

+ 

+ 

+ 

063 

00111111 

+ 

+ 

+ 

+ 

065 

01000001 

+ 

+ 

+ 

+ 

067 

01000011 

+ 

+ 

+ 

+ 

069 

01000101 

+ 

+ 

+ 

+ 

070 

01000110 

+ 

+ 

+ 

+ 

071 

01000111 

+ 

+ 

+ 

+ 

073 

01001001 

+ 

+ 

+ 

+ 

075 

01001011 

+ 

+ 

+ 

+ 

077 

01001101 

+ 

+ 

+ 

+ 

078 

01001110 

+ 

+ 

+ 

+ 

079 

01001111 

+ 

+ 

+ 

+ 

081 

01010001 

+ 

+ 

+ 

+ 

083 

01010011 

+ 

+ 

+ 

+ 

085 

01010101 

+ 

+ 

+ 

+ 

086 

01010110 

+ 

+ 

+ 

+ 

087 

01010111 

+ 

+ 

+ 

+ 

089 

01011001 

+ 

+ 

+ 

+ 

091 

01011011 

+ 

+ 

+ 

+ 

093 

01011101 

+ 

+ 

+ 

+ 

094 

01011110 

+ 

+ 

+ 

+ 

095 

01011111 

+ 

+ 

+ 

+ 

097 

01100001 

+ 

+ 

+ 

+ 

099 

01100011 

+ 

+ 

+ 

+ 

101 

01100101 

+ 

+ 

+ 

+ 

102 

01100110 

+ 

+ 

+ 

+ 

103 

01100111 

+ 

+ 

+ 

+ 

105 

01101001 

+ 

+ 

+ 

+ 

107 

01101011 

+ 

+ 

+ 

+ 

109 

01101101 

+ 

+ 

+ 

+ 
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110 

01101110 

+ 

+ 

+ 

+ 

111 

01101111 

+ 

+ 

+ 

+ 

113 

01110001 

+ 

+ 

+ 

+ 

115 

01110011 

+ 

+ 

+ 

+ 

117 

01110101 

+ 

+ 

+ 

+ 

118 

01110110 

+ 

+ 

+ 

+ 

119 

01110111 

+ 

+ 

+ 

+ 

121 

01111001 

+ 

+ 

+ 

+ 

123 

01111011 

+ 

+ 

+ 

+ 

125 

01111101 

+ 

+ 

+ 

+ 

126 

01111110 

+ 

+ 

+ 

+ 

127 

01111111 

+ 

+ 

+ 

129 

10000001 

+ 

+ 

+ 

+ 

131 

10000011 

+ 

+ 

+ 

+ 

133 

10000101 

+ 

+ 

+ 

+ 

134 

10000110 

+ 

+ 

+ 

+ 

135 

10000111 

+ 

+ 

+ 

+ 

137 

10001001 

+ 

+ 

+ 

+ 

139 

10001011 

+ 

+ 

+ 

+ 

141 

10001101 

+ 

+ 

+ 

+ 

142 

10001110 

+ 

+ 

+ 

+ 

143 

10001111 

+ 

+ 

+ 

+ 

145 

10010001 

+ 

+ 

+ 

+ 

147 

10010011 

+ 

+ 

+ 

+ 

149 

10010101 

+ 

+ 

+ 

+ 

150 

10010110 

+ 

+ 

+ 

+ 

151 

10010111 

+ 

+ 

+ 

+ 

153 

10011001 

+ 

+ 

+ 

+ 

155 

10011011 

+ 

+ 

+ 

+ 

157 

10011101 

+ 

+ 

+ 

+ 

158 

10011110 

+ 

+ 

+ 

+ 

159 

10011111 

+ 

+ 

+ 

+ 

161 

10100001 

+ 

+ 

+ 

+ 

163 

10100011 

+ 

+ 

+ 

+ 

165 

10100101 

+ 

+ 

+ 

+ 

166 

10100110 

+ 

+ 

+ 

+ 

167 

10100111 

+ 

+ 

+ 

+ 

169 

10101001 

+ 

+ 

+ 

+ 

171 

10101011 

+ 

+ 

+ 

+ 

173 

10101101 

+ 

+ 

+ 

+ 

174 

10101110 

+ 

+ 

+ 

+ 

175 

10101111 

+ 

+ 

t 

+ 

177 

10110001 

+ 

+ 

+ 

+ 

179 

10110011 

+ 

+ 

+ 

+ 

181 

10110101 

+ 

+ 

+ 

+ 

182 

10110110 

+ 

+ 

+ 

+ 

183 

10110111 

+ 

+ 

+ 

+ 

185 

10111001 

+ 

+ 

+ 

+ 

187 

10111011 

+ 

+ 

+ 

+ 

189 

10111101 

+ 

+ 

+ 

+ 

190 

10111110 

+ 

+ 

+ 

+ 

191 

10111111 

+ 

+ 

+ 

+ 

193 

11000001 

+ 

+ 

+ 

+ 

195 

11000011 

+ 

+ 

+ 

+ 

197 

11000101 

+ 

+ 

+ 

+ 

198 

11000110 

+ 

+ 

+ 

+ 
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199 

11000111 

+ 

+ 

+ 

+ 

201 

11001001 

+ 

+ 

+ 

+ 

203 

11001011 

+ 

+ 

+ 

+ 

205 

11001101 

+ 

+ 

+ 

+ 

206 

11001110 

+ 

+ 

+ 

+ 

207 

11001111 

+ 

+ 

+ 

+ 

209 

11010001 

+ 

+ 

+ 

+ 

211 

11010011 

+ 

+ 

+ 

+ 

213 

11010101 

+ 

+ 

+ 

+ 

214 

11010110 

+ 

+ 

+ 

+ 

215 

11010111 

+ 

+ 

+ 

+ 

217 

11011001 

+ 

+ 

+ 

+ 

219 

11011011 

+ 

+ 

+ 

+ 

221 

11011101 

+ 

+ 

+ 

+ 

222 

11011110 

+ 

+ 

+ 

+ 

223 

11011111 

+ 

+ 

+ 

+ 

225 

11100001 

+ 

+ 

+ 

+ 

227 

11100011 

+ 

+ 

+ 

+ 

229 

11100101 

+ 

+ 

+ 

+ 

230 

11100110 

+ 

+ 

+ 

+ 

231 

11100111 

+ 

+ 

+ 

+ 

233 

11101001 

+ 

+ 

+ 

+ 

235 

11101011 

+ 

+ 

+ 

+ 

237 

11101101 

+ 

+ 

+ 

+ 

238 

11101110 

+ 

+ 

+ 

+ 

239 

11101111 

+ 

+ 

+ 

+ 

241 

11110001 

+ 

+ 

+ 

+ 

243 

11110011 

+ 

+ 

+ 

+ 

245 

11110101 

+ 

+ 

+ 

+ 

246 

11110110 

+ 

+ 

+ 

+ 

247 

11110111 

+ 

+ 

+ 

+ 

249 

11111001 

+ 

+ 

+ 

+ 

251 

11111011 

+ 

+ 

+ 

+ 

253 

11111101 

+ 

+ 

+ 

+ 

254 

11111110 

+ 

+ 

+ 

+ 

255 

11111111 

+ 

+ 

+ 

+ 

002 

00000010 

+ 

- 

+ 

- 

010 

00001010 

+ 

- 

+ 

- 

018 

00010010 

+ 

- 

+ 

- 

026 

00011010 

+ 

- 

+ 

- 

034 

00100010 

+ 

- 

+ 

- 

042 

00101010 

+ 

- 

+ 

- 

050 

00110010 

+ 

- 

+ 

- 

058 

00111010 

+ 

- 

+ 

- 

066 

01000010 

+ 

- 

+ 

- 

074 

01001010 

+ 

- 

+ 

- 

082 

01010010 

+ 

- 

+ 

- 

090 

01011010 

+ 

- 

+ 

- 

098 

01100010 

+ 

- 

+ 

- 

106 

01101010 

+ 

- 

+ 

- 

114 

01110010 

+ 

- 

+ 

- 

122 

01111010 

+ 

- 

+ 

- 

130 

10000010 

+ 

- 

+ 

- 

138 

10001010 

+ 

- 

+ 

- 

146 

10010010 

+ 

- 

+ 

- 

154 

10011010 

+ 

- 

+ 

- 
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162 

10100010 

+ 

- 

+ 

170 

10101010 

+ 

- 

+ 

178 

10110010 

+ 

- 

+ 

186 

10111010 

+ 

- 

+ 

194 

11000010 

+ 

- 

+ 

202 

11001010 

+ 

- 

+ 

210 

11010010 

+ 

- 

+ 

218 

11011010 

+ 

- 

+ 

226 

11100010 

+ 

- 

+ 

234 

11101010 

+ 

- 

+ 

242 

11110010 

+ 

- 

+ 

250 

11111010 

+ 

- 

+ 

004 

00000100 

- 

+ 

+ 

012 

00001100 

- 

+ 

+ 

020 

00010100 

- 

+ 

+ 

028 

00011100 

- 

+ 

+ 

036 

00100100 

- 

+ 

+ 

044 

00101100 

- 

+ 

+ 

052 

00110100 

- 

+ 

+ 

060 

00111100 

- 

+ 

+ 

068 

01000100 

- 

+ 

+ 

076 

01001100 

- 

+ 

+ 

084 

01010100 

- 

+ 

+ 

092 

01011100 

- 

+ 

+ 

100 

01100100 

- 

+ 

+ 

108 

01101100 

- 

+ 

+ 

116 

01110100 

- 

+ 

+ 

124 

01111100 

- 

+ 

+ 

132 

10000100 

- 

+ 

+ 

140 

10001100 

- 

+ 

+ 

148 

10010100 

- 

+ 

+ 

156 

10011100 

- 

+ 

+ 

164 

10100100 

- 

+ 

+ 

172 

10101100 

- 

+ 

+ 

180 

10110100 

- 

+ 

+ 

188 

10111100 

- 

+ 

+ 

196 

11000100 

- 

+ 

+ 

204 

11001100 

- 

+ 

+ 

212 

11010100 

- 

+ 

+ 

220 

11011100 

- 

+ 

+ 

228 

11100100 

- 

+ 

+ 

236 

11101100 

- 

+ 

+ 

244 

11110100 

- 

+ 

+ 

252 

11111100 

- 

+ 

+ 

008 

00001000 

- 

- 

+ 

024 

00011000 

- 

- 

+ 

040 

00101000 

- 

- 

+ 

056 

00111000 

- 

- 

+ 

072 

01001000 

- 

- 

+ 

088 

01011000 

- 

- 

+ 

104 

01101000 

- 

- 

+ 

120 

01111000 

- 

- 

+ 

136 

10001000 

- 

- 

+ 

152 

10011000 

- 

- 

+ 

168 

10101000 

- 

- 

+ 

184 

10111000 

- 

- 

+ 
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200 

11001000 

- 

- 

+ 

- 

216 

11011000 

- 

- 

+ 

- 

232 

11101000 

- 

- 

+ 

- 

248 

11111000 

- 

- 

+ 

- 

000 

00000000 

- 

- 

- 

- 

016 

00010000 

- 

- 

- 

032 

00100000 

- 

- 

- 

- 

048 

00110000 

- 

- 

- 

- 

064 

01000000 

- 

- 

- 

- 

080 

01010000 

- 

- 

- 

- 

096 

01100000 

- 

- 

- 

- 

112 

01110000 

- 

- 

- 

- 

128 

10000000 

- 

- 

- 

- 

144 

10010000 

- 

- 

- 

- 

160 

10100000 

- 

- 

- 

- 

176 

10110000 

- 

- 

- 

- 

192 

11000000 

- 

- 

- 

- 

208 

11010000 

- 

- 

- 

- 

224 

11100000 

- 

- 

- 

- 

240 

11110000 

- 

- 

- 

- 

###################################################################### 


Now,  if  we  exclude  total  theories  with  objects  which  are  disallowed  by  the 
database,  then  we  are  left  with  the  following  total  theories: 


000 

00000000 

- 

- 

- 

- 

001 

00000001 

+ 

+ 

+ 

+ 

002 

00000010 

+ 

- 

+ 

- 

003 

00000011 

+ 

+ 

+ 

+ 

004 

00000100 

- 

+ 

+ 

- 

005 

00000101 

+ 

+ 

+ 

+ 

006 

00000110 

+ 

+ 

+ 

+ 

007 

00000111 

+ 

+ 

+ 

+ 

008 

00001000 

- 

- 

+ 

- 

009 

00001001 

+ 

+ 

+ 

+ 

010 

00001010 

+ 

- 

+ 

- 

Oil 

00001011 

+ 

+ 

+ 

+ 

012 

00001100 

- 

+ 

+ 

- 

013 

00001101 

+ 

+ 

+ 

014 

00001110 

+ 

+ 

+ 

+ 

015 

00001111 

+ 

+ 

+ 

+ 

016 

00010000 

- 

- 

- 

- 

017 

00010001 

+ 

+ 

+ 

+ 

018 

00010010 

+ 

- 

+ 

- 

019 

00010011 

+ 

+ 

+ 

+ 

020 

00010100 

- 

+ 

+ 

- 

021 

00010101 

+ 

+ 

+ 

+ 

022 

00010110 

+ 

+ 

+ 

+ 

023 

00010111 

+ 

+ 

+ 

+ 

024 

00011000 

- 

- 

+ 

- 

025 

00011001 

+ 

+ 

+ 

+ 

026 

00011010 

+ 

- 

+ 

- 

027 

00011011 

+ 

+ 

+ 

+ 

028 

00011100 

- 

+ 

+ 

- 

029 

00011101 

+ 

+ 

+ 

+ 
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030 

00011110 

+ 

+ 

+ 

+ 

031 

00011111 

+ 

+ 

+ 

+ 

128 

10000000 

- 

- 

- 

- 

129 

10000001 

+ 

+ 

+ 

+ 

130 

10000010 

+ 

- 

+ 

- 

131 

10000011 

+ 

+ 

+ 

+ 

132 

10000100 

- 

+ 

+ 

- 

133 

10000101 

+ 

+ 

+ 

+ 

134 

10000110 

+ 

+ 

+ 

+ 

135 

10000111 

+ 

+ 

+ 

+ 

136 

10001000 

- 

- 

+ 

- 

137 

10001001 

+ 

+ 

+ 

+ 

138 

10001010 

+ 

- 

+ 

- 

139 

10001011 

+ 

+ 

+ 

+ 

140 

10001100 

- 

+ 

+ 

- 

141 

10001101 

+ 

+ 

+ 

+ 

142 

10001110 

+ 

+ 

+ 

+ 

143 

10001111 

+ 

+ 

+ 

+ 

144 

10010000 

- 

- 

- 

- 

145 

10010001 

+ 

+ 

+ 

+ 

146 

10010010 

+ 

- 

+ 

- 

147 

10010011 

+ 

+ 

+ 

+ 

148 

10010100 

- 

+ 

+ 

- 

149 

10010101 

+ 

+ 

+ 

+ 

150 

10010110 

+ 

+ 

+ 

+ 

151 

10010111 

+ 

+ 

+ 

+ 

152 

10011000 

- 

- 

+ 

- 

153 

10011001 

+ 

+ 

+ 

+ 

154 

10011010 

+ 

- 

+ 

- 

155 

10011011 

+ 

+ 

+ 

+ 

156 

10011100 

- 

+ 

+ 

- 

157 

10011101 

+ 

+ 

+ 

+ 

158 

10011110 

+ 

+ 

+ 

+ 

159 

10011111 

+ 

+ 

+ 

+ 

###################################################################### 


Again,  the  same  theories  are  sorted  by  +/- ’s,  to  facilitate  the  determination 
of  how  many  (and  which )  theories  are  above  B\,B2,Cz,C±  (recall  that  we  now 
consider  only  those  theories  which  are  “allowed”  by  the  database): 


001 

00000001 

+ 

+ 

+ 

+ 

003 

00000011 

+ 

+ 

+ 

+ 

005 

00000101 

+ 

+ 

+ 

+ 

006 

00000110 

+ 

+ 

+ 

+ 

007 

00000111 

+ 

+ 

+ 

+ 

009 

00001001 

+ 

+ 

+ 

+ 

Oil 

00001011 

+ 

+ 

+ 

+ 

013 

00001101 

+ 

+ 

+ 

+ 

014 

00001110 

+ 

+ 

+ 

+ 

015 

00001111 

+ 

+ 

+ 

+ 

017 

00010001 

+ 

+ 

+ 

+ 

019 

00010011 

+ 

+ 

+ 

+ 

021 

00010101 

+ 

+ 

+ 

+ 

022 

00010110 

+ 

+ 

+ 

+ 

023 

00010111 

+ 

+ 

+ 

+ 

025 

00011001 

+ 

+ 

+ 

+ 
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027 

00011011 

+ 

+ 

+ 

+ 

029 

00011101 

+ 

+ 

+ 

+ 

030 

00011110 

+ 

+ 

+ 

+ 

031 

00011111 

+ 

+ 

+ 

+ 

129 

10000001 

+ 

+ 

+ 

+ 

131 

10000011 

+ 

+ 

+ 

+ 

133 

10000101 

+ 

+ 

+ 

+ 

134 

10000110 

+ 

+ 

+ 

+ 

135 

10000111 

+ 

+ 

+ 

+ 

137 

10001001 

+ 

+ 

+ 

+ 

139 

10001011 

+ 

+ 

+ 

+ 

141 

10001101 

+ 

+ 

+ 

+ 

142 

10001110 

+ 

+ 

+ 

+ 

143 

10001111 

+ 

+ 

+ 

+ 

145 

10010001 

+ 

+ 

+ 

+ 

147 

10010011 

+ 

+ 

+ 

+ 

149 

10010101 

+ 

+ 

+ 

+ 

150 

10010110 

+ 

+ 

+ 

+ 

151 

10010111 

+ 

+ 

+ 

+ 

153 

10011001 

+ 

+ 

+ 

+ 

155 

10011011 

+ 

+ 

+ 

+ 

157 

10011101 

+ 

+ 

+ 

+ 

158 

10011110 

+ 

+ 

+ 

+ 

159 

10011111 

+ 

+ 

+ 

+ 

002 

00000010 

+ 

- 

+ 

- 

010 

00001010 

+ 

- 

+ 

- 

018 

00010010 

+ 

- 

+ 

- 

026 

00011010 

+ 

- 

- 

130 

10000010 

+ 

- 

+ 

- 

138 

10001010 

+ 

- 

+ 

- 

146 

10010010 

+ 

- 

+ 

- 

154 

10011010 

+ 

- 

+ 

- 

004 

00000100 

- 

+ 

+ 

- 

012 

00001100 

- 

+ 

+ 

- 

020 

00010100 

- 

+ 

+ 

- 

028 

00011100 

- 

+ 

+ 

- 

132 

10000100 

- 

+ 

+ 

- 

140 

10001100 

- 

+ 

+ 

- 

148 

10010100 

- 

+ 

+ 

- 

156 

10011100 

- 

+ 

+ 

- 

008 

00001000 

- 

- 

+ 

- 

024 

00011000 

- 

- 

+ 

- 

136 

10001000 

- 

- 

+ 

- 

152 

10011000 

- 

- 

+ 

- 

000 

00000000 

- 

- 

- 

- 

016 

00010000 

- 

- 

- 

- 

128 

10000000 

- 

- 

- 

- 

144 

10010000 

'  - 

- 

- 

- 

###################################################################### 
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